Using a TL431 with a transistor could be a viable alternative.
It's not possible to use the device and draw power off a USB port anyway. Even LDO regulators wouldn't work when there's virtually no input/ output voltage differential.
Try using smallish Sealed Lead Acid batteries. They generally offer much more power storage and have lower discharge rates.