Follow

@Gargron looks nice! I wonder if it'd be viable to quickly run some simple OCR on the image and offer that as a description?

· · Web · 1 · 0 · 0

@noiob Okay, I'm looking at Tesseract.js. Seems like it's possible, I wonder how much it would add to the JS size though!

@Gargron yeah, it might be better to make that opt-in

@noiob It would be cool to have an actual neural net try to label images. Facebook and Google Photos do this to generate alt text. A lot more involved than OCR though...

@Gargron I've seen it on Instagram and it's really not worth it on there, it's all stuff like "image may contain person, text"

@noiob @Gargron I've experimented with aws recognition but well imagine the wad of bills emoji with wings flying from the community to Jeff bezos

@bonzoesc @noiob @Gargron Plus more privacy-conscious folks will find it creepy.

@mkb @noiob @Gargron literally anyone should find asking a huge dod supplier to look closely at their photos creepy

@Gargron @noiob that is generally a Really Expensive operation and even state of the art ones are somewhat mediocre because you have two operations that are hard in a row, image to concept and concept to text (consider twitter.com/picdescbot?lang=en - the descriptions aren't even particularly detailed and they are still wrong or useless most of the time)

@halcy @Gargron yeah, and I don't see people complaining about writing image descriptions, I've seen a lot of folks even get a bit creative with it

@sorin Hey, tesseract.js tries to load stuff from unpkg by default and I obviously need to self-host everything... Their class takes a script URL for a Worker but I'm not sure how to make it load a local version with webpack? Any ideas?

@Gargron Hey, you probably need to copy the worker script in /static (either manually or via something like copy-webpack-plugin) and then pass that path to the class.

Sign in to participate in the conversation
Awoo Space

Awoo.space is a Mastodon instance where members can rely on a team of moderators to help resolve conflict, and limits federation with other instances using a specific access list to minimize abuse.

While mature content is allowed here, we strongly believe in being able to choose to engage with content on your own terms, so please make sure to put mature and potentially sensitive content behind the CW feature with enough description that people know what it's about.

Before signing up, please read our community guidelines. While it's a very broad swath of topics it covers, please do your best! We believe that as long as you're putting forth genuine effort to limit harm you might cause – even if you haven't read the document – you'll be okay!