After starting, current can often flow out of the leisure batteries then after a while the not-so-smart alternator will bang the amps back into the starter battery, but because the split charge is only a relay the leisure batteries will get the same charge, but as they top back up and the internal resistance changes this should drop, unfortunately, the panel goes to sleep quite quickly so unless you keep waking it up you don't often get to see for how long before it drops back down.
Also, are you sure they are charging on hookup, there is a common problem with the plug falling out of the charger, so you think you are charging them on hookup but actually you are not.