I agree that if you get reductive enough you can start saying things like "how many Jews died just because there was an apocalyptic war going on," but it's pretty different than civilian deaths in E. European countries et al because killing Jews was intentional German policy vs. a side effect of the war.
Nazi policy was incoherent. Killing some categories of non-Jews was deliberate policy. Among the various plans that came & went, some of which started to be put into effect (though scrappily), were plans to reduce the population between Germany & the Urals drastically, to create room for a massive expansion of the German population. Depending on which plan, this could involve the killing of 100 million Slavs, Balts, etc. The expulsion of huge numbers of Poles from territories annexed to the Reich was part of the vaguely sketched out (in numerous contradictory versions) plan for a Greater German Reich. Many of those expelled died, as the lands they were expelled into couldn't support them. This was intended. Deaths from illness & outright starvation as a result of stripping some occupied territories of food, to maintain German food supplies, were also intended. They were seen as desirable by the Nazi leadership & their ideological theorists, part of the incoherent, self-contradictory master plan, which could, at the same time, envisage clearing vast tracts of land of their inhabitants & re-populating them with a self-reliant population of egalitarian German peasants, a hyper-modern industrial state with autobahns & high-speed railways linking the Atlantic to the Urals, a new junker class lording it over Slavic subjects in the very places that had been depopulated, moving all the scattered ethnic Germans of everywhere from Voivodina to the Volga to the newly expanded Reich to re-populate the areas cleared of Poles (a lot of this was done: Baltic & Bessarabian Germans were moved en masse), leaving those very same Germans in place as nuclei of the to-be-expanded German populations of lands not yet formally within the Reich but which would be one day, & sending settlers from Germany to settle parts of the east which had never before seen a German. Some poor buggers were shipped back east to the very same places they'd been shipped west from, just in time to face the fury of the returning Red Army.
Now, try to fit all that into the neat narrative of the Nazis exterminating Jews on ideological grounds & other deaths being collateral damage in a war fought with particular savagery. Doesn't work, does it?
What is missing from most discussion is the realisation that the Jews were just the first step. Originally, the idea wasn't to kill them all, but remove them from Germany. That turned into killing them when it was decided that removal was impractical. The same applied to the Slavs, though with more nuances. There was an idea that some of them were really Aryan, slavified descendants of ancient Europeans of the same type as Germans, & could be assimilated, but this was a contentious area. Look at what happened to Poles, for example. Some German administrators turned to the idea of assimilation with relief, & gave out certificates of Germanness en masse, even to those who didn't want them, despite the personal advantages that went with them under German rule. Those administrators usually saw the whole thing as a sham. Some called every industrial worker 'German', for example, being practically minded. Others resisted the assimilation idea. The proportion of Poles in territories annexed to Germany suddenly turned into Germans thus varied enormously, & entirely due to different local policies.
But what of those who were not to be assimilated? Again, incoherence in policy. According to when, where, & who was in charge locally, they were to be expelled further east, prevented from breeding so they would eventually die out, turned into slaves, or murdered en masse - or some combination of any or all of these.
THAT was the Holocaust Nazi dreamers wanted, & started trying to implement. A ghastly nightmare in which half of Europe would be a killing ground, with entire peoples doomed to extinction, some biological, some cultural, & most a combination of the two, in which, if it had been implemented in its entirety, the poor bloody Jews would just be a footnote, swamped by those former peoples the Poles, Ukrainians, Czechs, etc.
Now, do you see why I think that it's wrong to focus too much on what the Nazis did to the Jews? They had the immense misfortune to be first on the Nazi list, partly because of Hitler's personal hatreds, partly for purely practical reasons (being a minority almost everywhere, & a local majority only in very tightly defined areas, i.e. particular towns & villages, & suffering from sever prejudice against them, they were easy victims). That made them the greatest sufferers from Nazi persecution in terms of the proportion of their population who were killed, followed by the Roma. For that, they deserve special sympathy. But the myth that they were the only people targeted is just that, a myth. They were the most intensely & efficiently targeted, but if time & circumstances had allowed, other peoples were meant to suffer much the same fate. This would not have been a side effect of the war: it was the purpose of the war
When one thinks about that, it's a vision of something even more terrible than what actually happened.