Appropriate assessment of the accuracy of burned area products is required to assess greenhouse gas (GHG) emissions in a reliable way. This paper provides validation results for three burned area products with different pixel sizes: MCD45 (500 m), GlobCarbon (1 km), and L3JRC (1 km) for the Orinoco River basin, which is widely affected by fires, many of them oriented towards the conversion of Amazonian forest to cattle pasture. Accuracy measurements were based on commission and omission errors computed from 15 confusion matrices, as well as in the Pareto Boundary concept, which evaluates the impact of different pixel sizes in omission and commission errors. An edge metric was used to analyze the impact of shapes of burned patches on global accuracy. It was shown that all products underestimate burned-area and that an increase in pixel size or burned patch elongation, results in larger estimation errors.