• TachyonTele@lemm.ee
    link
    fedilink
    arrow-up
    52
    arrow-down
    9
    ·
    edit-2
    1 month ago

    Basically, yes. Our eyes capture the light that goes into them at 24 frames per second (please correct me if I goofed on that) and the image is upside down.

    Our brains turn those images upright, and it also fills in the blanks. The brain basically guesses what’s going on between the frames. It’s highly adapt at pattern recognition and estimation.

    My favorite example of this is our nose. Look at you nose. You can look down and see it a little, and you can close one eye and see more of it. It’s right there in the bottom center of our view, but you don’t see it at all everyday.

    That’s because it’s always there, and your brain filters it out. The pattern of our nose being there doesn’t change, so your brain just ignores it unless you want to intentionally see it. You can extrapolate that to everything else. Most things the brain expects to see, and does see through our eyes, is kind of ignored. It’s there, but it’s not as important as say, anything that’s moving.

    Also, and this is fun to think about, we don’t even see everything. The color spectrum is far wider than what our eyes can recognize. There are animals, sea life and insects that can see much much more than we can.

    But to answer more directly, you are right, the brain does crazy heavy lifting for all of our senses, not just sight. Our reality is confined to what our bodies can decifer from the world through our five senses.

    • calabast@lemm.ee
      link
      fedilink
      arrow-up
      64
      arrow-down
      1
      ·
      edit-2
      1 month ago

      We definitely are seeing things faster than 24 Hz, or we wouldn’t be able to tell a difference in refresh rates above that.

      Edit: I don’t think we have a digital, on-off refresh rate of our vision, so fps doesn’t exactly apply. Our brain does turn the ongoing stream of sensory data from our eyes into our vision “video”, but compared to digital screen refresh rates, we can definitely tell a difference between 24 and say 60 fps.

      • TachyonTele@lemm.ee
        link
        fedilink
        arrow-up
        29
        ·
        1 month ago

        Yeah it’s not like frames from a projector. It’s a stream. But the brain skips parts that haven’t changed.

      • Steve@communick.news
        link
        fedilink
        English
        arrow-up
        28
        arrow-down
        4
        ·
        edit-2
        1 month ago

        People looking at a strobing light, start to see it as just “on” (not blinking anymore) at almost exactly 60Hz.
        In double blind tests, pro gamers can’t reliably tell 90fps from 120.
        There is however, an unconscious improvement to reaction time, all the way up to 240fps. Maybe faster.

        • RecluseRamble@lemmy.dbzer0.com
          link
          fedilink
          arrow-up
          18
          ·
          1 month ago

          It seems to be more complicated than that

          However, when the modulated light source contains a spatial high frequency edge, all viewers saw flicker artifacts over 200 Hz and several viewers reported visibility of flicker artifacts at over 800 Hz. For the median viewer, flicker artifacts disappear only over 500 Hz, many times the commonly reported flicker fusion rate.

        • seaQueue@lemmy.world
          link
          fedilink
          arrow-up
          13
          ·
          1 month ago

          The real benefit of super high refresh rates is the decrease in latency for input. At lower rates the lag between input and the next frame is extremely apparent, above about ~144hz it’s much less noticable.

          The other side effect of running at high fps is that when heavy processing occurs and there are frame time lags they’re much less noticable because the minimum fps is still very high. I usually tell people not to pay attention to the maximum fps rather look at the average and min.

        • Contramuffin@lemmy.world
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          1 month ago

          I think having higher frame rates isn’t necessarily about whether our eyes can perceive the frame or not. As another commenter pointed out there’s latency benefits, but also, the frame rate affects how things smear and ghost as you move them around quickly. I don’t just mean in gaming. Actually, it’s more obvious when you’re just reading an article or writing something in Word. If you scroll quickly, the words blur and jitter more at low frame rates, and this is absolutely something you can notice. You might not be able to tell the frametime, but you can notice that a word is here one moment and next thing you know, it teleported 1 cm off

      • Ekky@sopuli.xyz
        link
        fedilink
        arrow-up
        7
        arrow-down
        1
        ·
        1 month ago

        I think i read that fighter pilots need to be able to identify a plane in one frame at 300 fps, and that the theoretical limit of the eye is 1000+ fps.

        Though, whether the brain can manage to process the data at 1000+ fps is questionable.

        • Fester@lemm.ee
          link
          fedilink
          English
          arrow-up
          5
          arrow-down
          1
          ·
          1 month ago

          I’m using part of this comment to inform my monitor purchases for the rest of my life.

        • nimpnin@sopuli.xyz
          link
          fedilink
          arrow-up
          3
          ·
          1 month ago

          Both of these claims are kinda misguided. The brain is able to detect very short flashes of light (say, 1 thousandth of a second), and other major changes in light perception. Especially an increase in light will be registered near instantly. However, since it doesn’t have a set frame rate, more minor changes in the light perception (say, 100 fps) are not going to be registered. And the brain does try to actively correct discontinuities, that’s why even 12 fps animation feels like movement, although a bit choppy.

      • Venator@lemmy.nz
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        1 month ago

        You’re right that is a continuous process, so there’s no frame rate as such. 24 fps is just the lowest framerate that doesn’t look “framey” in videos, but can go as low as 12 and still reliably perceive it as movement, which is why most stop motion films are done at 12fps.

        The amount of motion blur we see on fast moving objects is similar to a 24fps camera with a normal shutter angle setting, but we don’t perceive any blur when we turn our heads or move our eyes like a camera at that fps does.

        There’s also our reaction time, which can vary a lot depending on a plethora of factors, but averages around 250ms, which is similar to 4fps 😅… Or maybe since it’s a continuous process it’s more like ♾️fps but with a 250ms delay 🤔😅

      • Caveman@lemmy.world
        link
        fedilink
        arrow-up
        1
        ·
        1 month ago

        I would believe it if someone told me that an individual rod or cone in the eye was 24fps but they’re most likely not synched up

        • yoevli@lemmy.world
          link
          fedilink
          English
          arrow-up
          11
          arrow-down
          2
          ·
          1 month ago

          Completely untrue and not even up for debate. You’d know this if you had ever used a high-refresh rate display.

                • SorteKanin@feddit.dk
                  link
                  fedilink
                  arrow-up
                  4
                  arrow-down
                  1
                  ·
                  1 month ago

                  So what you meant to say is that you don’t see a difference above 60 Hz. But other people definitely can tell the difference. Don’t generalize on everyone based on your own experiences.

        • SoleInvictus@lemmy.blahaj.zone
          link
          fedilink
          arrow-up
          4
          ·
          edit-2
          1 month ago

          It’s noticeable, it’s just not massive. My phone screen runs at 120hz but I don’t notice a difference unless I’m scrolling rapidly. Gaming culture (driven by corporations) really overemphasizes its importance. Gamers as a group seem to be easily duped by impressive sounding numbers, just like the rest of the population.

          Also keep in mind there likely isn’t a lot of selective pressure on biological vision refresh rate, so I wouldn’t be surprised if there’s a fair amount of variability in the ability to discern a difference amongst individuals.

            • SoleInvictus@lemmy.blahaj.zone
              link
              fedilink
              arrow-up
              3
              ·
              1 month ago

              It’s a hot button topic for some people. I’m for the biological variation explanation - some people seem to really notice a difference while others don’t.

              I think what the people who get really upset notice is that they dropped a few extra $100s on what’s often largely a marketing gimmick.

    • HatchetHaro@lemmy.blahaj.zone
      link
      fedilink
      arrow-up
      36
      ·
      1 month ago

      the 24 fps thing is one hella myth. our cones and rods send a continuous stream of information, which is blended with past-received information in our perception to remove stuff like the movement from darting your eyes around.

    • leds@feddit.dk
      link
      fedilink
      arrow-up
      8
      ·
      1 month ago

      Also, your eyes dart around and you only see a little patch. You blink. Your brain makes up a nice stable image of the world, mostly consisting of things that your brain think should be there.

    • Reyali@lemm.ee
      link
      fedilink
      arrow-up
      5
      ·
      1 month ago

      If you want a fun experiment of all the things we see but don’t actually process, I recommend the game series I’m On Observation Duty. You flip through a series of security cameras and identify when something changed. It’s incredible when you realize the entire floor of a room changed or a giant thing went missing, and you just tuned it out because your brain never felt a need to take in that detail.

      It’s sorta horror genre and I hate pretty much every other horror thing, but I love those games because they make me think about how I think.

  • Nibodhika@lemmy.world
    link
    fedilink
    arrow-up
    33
    arrow-down
    1
    ·
    1 month ago

    One thing I find very interesting about how brains process reality is that there’s a disease that makes your eyes have blind spots. However people with that disease don’t see those blind spots because the brain fills the gaps with the information it knows to be there. So you could see a door closed just as it was when you last looked at it directly, but in the meantime someone opened the door and you’re still seeing the door closed until you look at it directly.

    • Lemminary@lemmy.world
      link
      fedilink
      arrow-up
      15
      ·
      1 month ago

      We all have blind spots because there’s a hole in the retina in the back of the eye for the optical nerve. The spots are located on the outer top side of our field of view and you can become aware of them with some visual tests online.

      • Eiri@lemmy.ca
        link
        fedilink
        arrow-up
        3
        ·
        1 month ago

        Another fun thing you can do is look at the sky (not the sun!) on a sunny day and start seeing your blood circulation and blind spot.

        • pixeltree@lemmy.blahaj.zone
          link
          fedilink
          arrow-up
          2
          ·
          1 month ago

          The top commenter is correct. It’s why when you glance at a clock with a second hand, it can seem like it takes too long for it to move for the next second. It moved as you moved your eyes, and your brain didn’t make up the movement.

    • Juice@midwest.social
      link
      fedilink
      arrow-up
      7
      ·
      1 month ago

      There’s a rare disease that turns peoples faces into demon faces called prosopometamorphopsia that can be partially relieved by observing things under different colored light.

  • bstix@feddit.dk
    link
    fedilink
    arrow-up
    26
    ·
    edit-2
    1 month ago

    I don’t think it’s the brain but rather our consciousness that is limited. Our sensory inputs are always on and processed by the brain, but our consciousness is very picky and also slow.

    People can sometimes recall true memories that they weren’t aware of, or react to things they didn’t think of and such.

    Consciousness is also somehow lagging behind the actual decision making, but always presents itself as the cause of action.

    Sort of like Windows telling you that you removed a USB stick 2 seconds after you did it and was well aware of it happening. Consciousness is like that, except it takes responsibility for it too…

    When it encounters something that it didn’t predict, it’ll tell you that “yeah this happened and this is why you did that”. Quite often the explanation for doing something is made up after it happened.

    This is a good thing mostly, because it allows you to react faster than having to consider your options consciousnessly. You do not need to or have time to make a conscious decision to dodge a dodgeball, but you’ll still think you did.

    • shalafi@lemmy.world
      link
      fedilink
      English
      arrow-up
      9
      arrow-down
      1
      ·
      1 month ago

      NAILED IT! Yeah, our subconscious is driving and only sends an executive summary up top. And we think, “I did this!” Nah. You didn’t. You are just along for the ride.

      People hate this notion because it negates free will. Well, yeah, it kinda does.

      • juststoppingby@lemm.ee
        link
        fedilink
        arrow-up
        7
        ·
        1 month ago

        Everybody reading these comments and considering the implications needs to go read Blindsight by Peter Watts. It’s a first contact story set in the near-ish future, and really goes into consciousness and intelligence. Very thought provoking if you thought this comment chain was interesting.

      • sartalon@lemmy.world
        link
        fedilink
        arrow-up
        5
        ·
        edit-2
        1 month ago

        You can train your subconscious! Well, at least influence it’s decisions. Videogames are a great example. Trained reaction/response. Repeated response to similar stimulus can create a trained subconscious response.

        However, I have difficulty, especially now that I’m older, where subconscious and conscious will compete and I will lose acuity of what I actually did.

        That and my memory is getting worse. :/

        • bstix@feddit.dk
          link
          fedilink
          arrow-up
          4
          ·
          1 month ago

          It is also possible to consciously alter the subconsciousness. For instance, by creating sensory input for yourself by saying things out loud to a mirror. Your ears will hear it, your eyes will see it, and your subconsciousness will then process it just the same as any other experience.

          With enough repetition it will make a difference in which neurons are active whenever the brain comes to making a decision on that thing.

      • RustyEarthfire@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        1 month ago

        That assumes “you” are just the conscious part. If you accept the rest of your brain (and body) as part of “you”, then it’s a less dramatic divide.

    • ContrarianTrail@lemm.ee
      link
      fedilink
      English
      arrow-up
      7
      arrow-down
      1
      ·
      1 month ago

      When it encounters something that it didn’t predict, it’ll tell you that “yeah this happened and this is why you did that”. Quite often the explanation for doing something is made up after it happened.

      There are interesting stories about tests done with split-brain patients, where the bridge connecting the left and right brain hemispheres, the corpus callosum, is severed. There are then ways to provide information to one hemisphere, have that hemisphere initiate an action, and then ask the other hemisphere why it did that. It will immediately make up a lie, even though we know that’s not the actual reason. Other than being consciouss, we’re not that different from ChatGPT. If the brain doesn’t know why something happened, it’ll make up a convincing explanation.

        • ContrarianTrail@lemm.ee
          link
          fedilink
          English
          arrow-up
          3
          ·
          1 month ago

          They’re very interesting, but also quite spooky as sometimes it seems to indicate there’s two different minds inside your head that are not aware of each other.

          If you search for “split brain experiments” you should be able to find more.

    • fine_sandy_bottom@lemmy.federate.cc
      link
      fedilink
      arrow-up
      3
      ·
      1 month ago

      This isn’t really what OP is talking about.

      We really can’t see very well at all outside of the centre of our focus. this paper says 6 degrees, I heard this as a coin held at arms length.

      Our minds “render” most of the rest of what we think we see.

      You’re right that we discard most of our sensory inputs, but with visual inputs there’s much less data than it appears.

      • bstix@feddit.dk
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        1 month ago

        You’re right. OPs second question is more specifically about vision, while I answered more broadly.

        Anyway, comparing it to data from a camera is not really possible.

        Analoge vs. digital and so, but also in the way that we experience it.

        The minds interpretation of vision is developed after birth. It takes several weeks before an infant can recognise anything and use the eyes for any purpose. Infants are probably blissfully experiencing meaningless raw sensory inputs before that. All the pattern recognition that is used to focus on things are learned features and so also dependent on actually learning them.

        I can’t find the source for this story, but allegedly there was this missionary in Africa who came across a tribe who lived in the jungle and was used to being surrounded by dense forest their entire life. He took some of them to the savannah and showed them the open view. They then tried to grab the animals that were grassing miles away. They didn’t develop a sense of perspective for things in longer distance, because they’d never experienced it.

        I don’t know if it’s true, but it makes a point. Some people are better at spotting things in motion or telling colours apart etc. than others. It matters how we use vision. Even in the moment. If I ask you to count all the red things in a room, you’ll see more red things that you were generally aware of. So the focus is not just the 6° angle or whatever. It’s what your brain is recognising for the pattern at mind.

        So the idea of quantifying vision to megapixels and framerate is kind of useless in understanding both vision and the brain. It’s connected.

        Same with sound. Some people have proved being able to use echo localisation similar to bats. You could test their vision blindfolded and they’d still make their way through a labyrinth or whatever.

        Testing senses is difficult because the brain tends to compensate in that way. It’d need to be a very precise testing method to make any kind of quantisation for a particular sense.

  • zarathustra0@lemmy.world
    link
    fedilink
    arrow-up
    14
    ·
    1 month ago

    Your brain is constantly processing the inputs from all of your senses and pretty much ignoring them if they fit with what it is already expecting.

    Your brain is lazy. If everything seems to fit with what your brain expects then you believe that what you are seing is reality and you generally ignore it.

    Generally the mind only focuses on what it believes is salient/interesting/unexpected.

    • Eheran@lemmy.world
      link
      fedilink
      arrow-up
      2
      ·
      1 month ago

      Imagine if we had image sensors that could filter like that. Boom, video 100 times smaller in size. “Autonomous” surveillance cameras running on fractions of the power. Etc. Etc. Just far more efficient.

      • Passerby6497@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        arrow-down
        1
        ·
        1 month ago

        That’s actually how a lot of video codecs work, they just throw a key frame in every so often that has the full image so you can just do diffs for the rest of the frames till the next key frame.

      • Beacon@fedia.io
        link
        fedilink
        arrow-up
        3
        arrow-down
        1
        ·
        1 month ago

        We do have those things. That’s how many technologies already work.

        • I_Miss_Daniel@lemmy.world
          link
          fedilink
          English
          arrow-up
          6
          ·
          1 month ago

          Yes. We get hints of this now and then when digital TV breaks up and only the moving parts are updating until the next key frame arrives.

  • spittingimage@lemmy.world
    link
    fedilink
    arrow-up
    10
    ·
    edit-2
    1 month ago

    Here’s an interesting related factoid - your eyes are constantly making tiny micromovements called saccades. During these movements, you don’t receive any visual information. Your actual view of the world comes in stuttering fits and starts. You don’t notice this because your brain literally invents what you think you’re seeing during saccades. It’s good enough not to get you weeded out of the gene pool.

    • Etterra@lemmy.world
      link
      fedilink
      arrow-up
      5
      ·
      1 month ago

      Yey your brain makes up an approximation of reality at best. It’s the weirdest fucking thing.

  • lath@lemmy.world
    link
    fedilink
    arrow-up
    7
    ·
    1 month ago

    I heard a similar thing. But a bit more complicated. It wouldn’t be just the eyes, but all senses used by the brain to edit a filtered vision of reality.

    And while the eyes take in everything they’re capable of, the brain only focuses on what it considers important. Which is probably false due to the many, many times one will search for something within their cone of vision, yet are unable to see it.

    So while I’m not sure of the details, the brain can be thought of as choosy with what it shows.

  • deafboy@lemmy.world
    link
    fedilink
    arrow-up
    6
    arrow-down
    1
    ·
    1 month ago

    https://omny.fm/shows/inner-cosmos-with-david-eagleman/ep78-does-your-brain-have-one-model-of-the-world-o

    Why do you see a unified image when you open your eyes, even though each part of your visual cortex has access to only a small part of the world? What is special about the wrinkled outer layer of the brain, and what does that have to do with the way that you explore and come to understand the world? Are there new theories of how the brain operates? And in what ways is it doing something very different than current AI? Join Eagleman with guest Jeff Hawkins, theoretician and author of “A Thousand Brains” to dive into Hawkins’ theory of many models running in the brain at once.

    • MonkderVierte@lemmy.ml
      link
      fedilink
      arrow-up
      5
      ·
      1 month ago

      And in what ways is it doing something very different than current AI?

      That’s equal to the question “What differrentiates a screw from a car?”.

  • someguy3@lemmy.world
    link
    fedilink
    arrow-up
    4
    ·
    1 month ago

    I mean all animals have brains to render reality, aka visual, audio, predator awareness. It’s not so special, most animals have tiny little brains.

  • Björn Tantau@swg-empire.de
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    1 month ago

    And in the end “reality” is just excitations in quantum fields. And you “perceive” mostly electromagnetic forces.