It's often burnt off because the quality / quantity / opportunity costs for capture and resale are often insufficiently compared to other extracted products.
What evidence do you have? Excess gas is routinely burned off nearby oil derricks to this very day because it's not cost-effective to capture for resale.