I believe it‘s even more strict than that (insert obligatory I am not a lawyer here).

For military commands, German soldiers must not obey orders that would constitute a criminal offense (§11(2) SG). Outside of that, the respective laws for civil servants are applicable (§11(3) SG). These laws, specifically §63 BBG, contain an obligation to object to illegal orders (Remonstrationspflicht). If a civil servant doesn‘t object, they are personally responsible for their actions.

So it‘s not just an option to object to unlawful orders, it‘s an obligation.

I think it’s quite possible to become confused if you’re used to software that, bugs aside, behaves pretty much completely predictably, then get a feature marketed as “intelligence” which suddenly gives you unpredictable and sometimes incorrect results. I‘d definitely be confused if the reliable tools I do my work with suddenly developed a mind of their own.

No, they didn’t dump it on the dark web. They‘ve dumped it on the regular web instead: https://okstupid.lol/