If you’re a regular on our website, you’ve probably noticed that the number of articles about DxOMark camera tests has decreased in recent months. It is not that we no longer pay attention to them, but it is that Xiaomi and other brands are no longer submitting their phones to DxOMark for testing.
For a few months now, smartphone manufacturers have pushed aside what we all considered to be one of the best benchmarks on mobile photography. But why is this happening?
Getting to the top of the table is complicated and brands don’t like that
In June, Xiaomi CEO and founder Lei Jun noted that his Xiaomi 12S would not be sent to DxOMark labs for camera testing. At the time, Jun pointed out that taking one of his top of the range to the DxOMark test was too expensive . In addition, he added that they were confident enough in their alliance with Leica to ensure that the cameras would exceed any expectations.
In the end, DxOMark itself bought a Xiaomi 12S Ultra and put it to the test , determining that it had excellent cameras, but not enough to make it into the top 3. With that, Xiaomi was settled, but this is not the only company that you are not submitting your devices for testing .
Recently, the CEO of DxOMark, Frédéric Guichard , was approached on this subject in an interview. Guichard did not focus on the Xiaomi case, but spoke of all manufacturers. His response was that OEMs were not sending their phones out for testing because it is very difficult for a new model to top the table .
Guichard knows that all brands want the crown, or at least a spot on the podium, because it is what allows them to promote themselves as phones with fantastic cameras. So much so, that this year DxOMark had to invent another badge beyond the score: the DxOMark Gold, Silver and Bronze Camera seals, which are awarded to smartphones with the best cameras, without having to be at the top. However, even these badges do not seem to be enough for the manufacturers to take heart.
No complaints with DxOMark tests from brands, they are reliable
As additional data, the CEO commented that no manufacturer complains about the tests or methodology used by DxOMark , since they consider them reliable. However, brands do not feel comfortable paying to test their new terminals when even their models from previous years can be better.
Examples of this we can see in two devices: first, the Xiaomi Mi 11 Ultra of 2021 is still in the top 3 , while the Xiaomi 12S Ultra of 2022 only reached fifth place; second, the 2020 Huawei Mate 40 Pro+ is still in fourth place, while 2021 and 2022 phones fail to surpass it.
Manufacturers don’t like this, but it happens for a simple reason: DxOMark offers a very objective methodology and score, which doesn’t get carried away because a mobile is newer or older. For the lab, a smartphone has a better camera or it doesn’t , it’s that simple.
Besides, DxOMark has repeatedly assured that it does not sell points or positions in the ranking of its platform . Its business model is the testing service in its laboratories. Meanwhile, the scores for a mobile will be what the tests dictate, they will not depend on whether a manufacturer pays for the test or if DxOMark does it on its own.
On the other hand, the other way of generating revenue for DxOMark is their evaluation and tuning service for smartphone cameras. By hiring him, the company’s experts help manufacturers optimize the photo sensors of their devices. This should help them get better scores in the ranking, but the limit is still what the results and the methodology mark.
