In Star Wars Rebels, there was an E-XD-series infiltrator droid that could quickly take inventory of everything in a Rebel warehouse. With the advanced object recognition capabilities of modern AI, it’s only a matter of time before an app for Android can accurately and rapidly identify and store objects in real-time from video capture. This could be similar to a home inventory app where users only need to capture video and move around the house instead of taking pictures and labeling items. When do you think such an app will become available? Also, what is the closest app available right now?

edit: I didn’t say offline or on-device, I don’t know why everyone assumes that. I mean a service offered through an Android app.

    • over_clox@lemmy.world
      link
      fedilink
      arrow-up
      8
      ·
      1 year ago

      Yes, but OP is referring to realtime object recognition. Although we don’t have to wait very long for object recognition right now, we still have to wait a bit. That’s not quite realtime.

      • dope@lemm.ee
        link
        fedilink
        English
        arrow-up
        2
        ·
        1 year ago

        Object recognition.

        Then “action recognition”. I mean, what the objects are doing. To each other and such.

        Then you have a narration machine. Which could be nice.

        • over_clox@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          edit-2
          1 year ago

          Very related, not my work though…

          Self Aware Lara Croft

          This seems like something of an ideal effort, but it also took lots of human work to even prepare the AI model, and many many runs to refine it.

          We’re not even close to realtime object recognition at this point. Delayed recognition, yes. Realtime, no.

          Edit: The self Aware Lara Croft series recently dropped their latest video of Level 7…

          https://piped.video/watch?v=SYX4CwyZ1LM