Research revealed 29% avoid anything that causes bloating and 28% stay clear of items that trigger stomach cramps.
As a result, 38% stick to the same safe meals, missing out on a more varied diet as a result.
And although 30% believe lactose-free products are healthier, seven in 10 have never added any to their shopping basket.
Rachel Campbell, from Arla, which commissioned the research to launch its LactoFREE range, said: “Our research shows we’re a nation who are missing out on a range of delicious meals.
“Whether you’re lactose intolerant or simply want to live your life without lactose, you should never feel restricted by your diet.”
Many want to make food choices that lead to feeling better physically (48%) and mentally (25%).
But 52% feel confused when it comes to getting nutrition and diet right.