Yeah, ours tends to kick around the house until such a time as I'm going to the tip for something more substantial. Even accounting for generating a lot more WEEE than the average household (we have a reputation for being able to repair and/or find a home for unwanted electrickery), its a pain.
Really small stuff (component-level parts, bits of wire, that sort of thing) tends to find its way into the household waste, because I'm not going to start going through bench-sweepings and hoover bags to separate LED legs and solder blobs from carpet fluff and bits of sticky tape.