Is your image a vector or is it a raster image?
If it's a vector, try break apart, or the equivalent command that inkscape uses for breaking apart compound elements.
If it's not a vector image, you can't break it apart and it's time to build from scratch.