Driving people out of work isn't really a problem, unless there ISNT some form of compensation to keep the money flowing to the demanders, who keep the machines working, and therefore the economy.
Dangers, would be robots working or having an agenda to kill human beings or any life on earth that wasn't causing illness to humans. They would have to be remotely Anthropocentric.
Another danger might be enslavement, but even if it was, if they were working to benefit mankind rather than cause them ailments, poverty, suffering, than that slavery might even be desired.
I can think of beings, even bots, in two time-lines, those that destroy the most powerfully, and those that can create the most powerfully.
Our first propagation of life outside of earth, into colonies, most likely will be of robotic-kind or cyborg kind.