However, looks can be deceiving, and this particular caterpillar is one you should definitely keep your distance from. While native to Canada, the hickory tussock caterpillar has also been sighted in New York and Pennsylvania. Hickory Tussock Caterpillars: Look, Don’t TouchIf you come across hickory tussock caterpillars crawling on foliage, it might be tempting to touch them. Why Hickory Tussock Caterpillar Hairs Can Hurt YouThe hairs on the hickory tussock caterpillar contain barbs that can easily break off and become embedded in your skin, leading to potential trouble. Not Deadly, But Still DangerousThe venom of the hickory tussock caterpillar is not highly toxic, so if you do touch one, you're probably not going to have catastrophic health issues.