I'm not really sure what you are asking, so I'll make some possibly related statements:
- The PacketWriter raw data is called each time you call LocalNetworkGamer.SendData (unfortunately). It won't persist across multiple SendData calls.
- You say the delay until the packet arrives is large - how often are you calling networkSession.Update()? If you don't call update on the sender and receiver side the data won't arrive.
I think we need more information before we can really say what the issue is.