You would need to place that worker under player, who is neither of the allies.
E.g.
Players Red, Blue and Cyan are in alliance. Place the worker under Player Purple and make that player an ally and share his units with the other 3 (real) players.
Downside is that the worker will have to be the only unit of player Purple.