It is tough. You are told which way the swarms are coming and you need to shift troops to that side of the map to greet them. A couple of wooden towers will typically slow down a swarm giving you time to react.
Also, rangers are really not very effective. They are for stealth and scouting missions. You want to get some iron production going fairly early to build soldiers who are far more effective at zombie killing and also more durable.