Yes, connect the coax from the antenna directly to the TV and do a channel scan (Don't drill any holes yet). Make sure you choose antenna or air, NOT cable, in the settings before starting the scan. It might be advantageous to use the newer TV for the initial scans and aiming as the tuner could be of a newer generation.
After the antenna is up and working you can easily add a splitter etc. for a second TV.
DO NOT use any cable co. supplied boxes with OTA as they are designed for cable frequencies and authentication.
RCA ANT-751 on Amazon:
http://www.amazon.com/RCA-Compact-Ou.../dp/B0024R4B5C