I believe it is Cannon hall. Not a great distance from where I live. Though it is closer to Barnsley/Wakefield than Huddersfield. It's a popular place even now.
This is part of it - http://www.cannonhallfarm.co.uk/ like a petting zoo ect but a quick Google will bring up some images of the hall itself as well.