Yeah, a bit of a stretch . . . found it amusing that you stated that no object exists, yet you were looking for a tool to manipulate said non-existent object *shrugs*
There are no screws that need to be hit, or nails that need to be rotated. But putting text and lines on a raster image is common as dirt, and I draw vector cartoons and characters on raster backgrounds.
Most of my dedicated photo manip these days is in either Affinity Photo, or PS.
When I'm really designing something, I use ADesigner (which handles bitmaps and precise vectors, together, extremely well).
Last project I did was for a fellow who was starting his business, and needed a card design, and some magnets for his truck. We hashed-out some ideas on paper, and I dropped photos of these into Designer. We then worked-through the process of transforming these into vectors. It was highly interactive process, and the ability to role-play tons of ideas/variations on multiple layers (hiding/showing) was extremely productive.
These were going to print/vinyl, but we raterised some proofs for sharing.
I also am tasked (in my regular work, on occasion) to create wire grids on walls&houses (on which climbing vines will grow), and I need to know exactly where my anchors must be set. It's not very professional to leave a bunch of erroneous pencil/pen marks (or drill holes) on the side of a $10M new construction
So, I take a photo of where it is to be made, drop that into Designer, get everything to-scale, then precisely plan-out and map my anchor points down to the millimeter.
I really don't think in either raster or vector. They are just modalities I use together to help take an idea and turn it into a real-world object.
My needs are simple--and ad-hoc--and I've found Designer to be an exceptionally functional tool for accomplishing such.
To-your-point, however,
Xara might fit your requirements for a all-in-one
