Bourbon Barrel Porter - Adding oak early in second fermentation?

It’s been a few years since I’ve brewed and I accidently skipped a step. Rather than let the beer sit in secondary for a few weeks I have already started soaking the oak chips in the bourbon. Would there be any issue with putting them into the secondary early?

Probably not…
Sneezles61