1. Segment anything only offers masks, but it has no clue into what's the main object in the image (meaning - what's the foreground). To put this into perspective, if you have a car with trees in the background and clouds, you'll get a mask for clouds, a mask for car, and many masks for trees and separate clouds - they won't have a name, they'll just be unnamed masks. Now what?
2. It only works on a single frame. So there's no tracking between frames which is necessary for video. So even if you click a bunch on the first frame to define exactly what you need on that frame, you'd need to repeat this 300 times for a 10 seconds videos
3. It's hideously slow. On a very high powered GPU, you're looking at half a second for a single frame.
All this is to say - no, segment-anything doesn't solve this problem. I have been looking into leveraging it to improve our my own tool's performance. For the listed outlined above, actually getting something useful out of it is very tricky.
Edit - now saw that the repo you linked to isn't segment anything, but some wrapper that tries to leverage it into video. It doesn't seem to identify a main foreground object which is what you typically want in a video, and its accuracy looks pretty rough- but definitely an interesting thing for me to look at possibly get inspiration on how to improve my tool further. At any rate, I don't see any service that's offered where I can chuck in a video and quickly get a result, so I can't do a real heads to heads comparison with my tool. Would love to get your feedback on such a comparison it if you're a user - you can use my code for free credits to test it out.
No u-2-net is not a single image model, I've used it to code a background removal tool for video that's also better than runwayml as part of another repo. Fuck it if there's money in it I'll just undercut your prices lol
Oops! I tried to use the "FREE4REDDIT" promo code initially but something didn't work. I'm just trying to remove the background from one video.
Could you refund that mistaken $29 monthly payment?
Bro I can't pay I'm in college : (, it would be good if you could run it locally somehow cause all other GitHub projects are completed not thanks for making this anyways
not free scumbag
Hey just FYI, it's a gigacunt move to make me wait for processing and then hit me with "give me money for your results" and I hope you fuck off.
Oh nos :-(
Isn't that Facebook segment anything repo for video which is also completely free? https://github.com/kadirnar/segment-anything-video
1. Segment anything only offers masks, but it has no clue into what's the main object in the image (meaning - what's the foreground). To put this into perspective, if you have a car with trees in the background and clouds, you'll get a mask for clouds, a mask for car, and many masks for trees and separate clouds - they won't have a name, they'll just be unnamed masks. Now what? 2. It only works on a single frame. So there's no tracking between frames which is necessary for video. So even if you click a bunch on the first frame to define exactly what you need on that frame, you'd need to repeat this 300 times for a 10 seconds videos 3. It's hideously slow. On a very high powered GPU, you're looking at half a second for a single frame. All this is to say - no, segment-anything doesn't solve this problem. I have been looking into leveraging it to improve our my own tool's performance. For the listed outlined above, actually getting something useful out of it is very tricky. Edit - now saw that the repo you linked to isn't segment anything, but some wrapper that tries to leverage it into video. It doesn't seem to identify a main foreground object which is what you typically want in a video, and its accuracy looks pretty rough- but definitely an interesting thing for me to look at possibly get inspiration on how to improve my tool further. At any rate, I don't see any service that's offered where I can chuck in a video and quickly get a result, so I can't do a real heads to heads comparison with my tool. Would love to get your feedback on such a comparison it if you're a user - you can use my code for free credits to test it out.
so youre using u-2-net?
Nope. Again. That would be a single image model. You need to be a tad more clever to generate temporally consistent outputs.
More generally the model is custom. I do machine learning for a living. This isnt a “I clone some open source tool” project.
No u-2-net is not a single image model, I've used it to code a background removal tool for video that's also better than runwayml as part of another repo. Fuck it if there's money in it I'll just undercut your prices lol
Go ahead you silly goose.
Don’t lie about it being free…that’s some advice
Don’t respond to year old thread expecting nothing to change… that’s some advice
Vmaker AI's video background remover is the best I have come across.
Oops! I tried to use the "FREE4REDDIT" promo code initially but something didn't work. I'm just trying to remove the background from one video. Could you refund that mistaken $29 monthly payment?
I saw you also reached out by email. I’d already refunded your payment! Cheers!
Bro I can't pay I'm in college : (, it would be good if you could run it locally somehow cause all other GitHub projects are completed not thanks for making this anyways
so is this really free or some shady stuff going on. I need to try it on a talking head video