Is anybody else running into this problem?

My federated posts are appearing in my timeline quite well, however I’ve noticed that significant portions of the comment section are not being carried over.

For example, I’ll see a post on my instance with 13 comments. I’ll click on the fediverse icon to take me to the original source and that has 43 comments. Where did those 30 comments go?

The worst part is, I can’t seem to figure out a way to “force sync” or refresh the page to make sure all the comments are carried over. Because of this, I feel like I’m only getting part of the conversation and I’m unable to reply to comments that don’t appear on my instance.

Does anybody have any solutions to this problem? It’s literally my one huge issue I have with my own instance.

  • PrincipleOfCharity@0v0.social
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 year ago

    Not sure if this is the same problem, but it has been noticed that passing messages between federated instances has been hampered by the way the “worker threads” are currently been done. The big instances are essentially getting overloaded with outbound federation work. Solutions for that are in the works. issue/3230

  • Jason@lemmy.weiser.social
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    Yeah, it’s definitely annoying, but if it’s any consolation, it’s a system-wide problem. Not sure if/when/how they fix, but if this place is going to be a long term Reddit replacement, I feel like they’re going to have to.

  • Granite@forum.fail
    link
    fedilink
    arrow-up
    3
    ·
    1 year ago

    Hopefully it’ll mostly resolve given time. Just like when there was a mass exodus to mastodon, the major thrediverse servers are getting overloaded. This creates delays and it seems even lost messages. From experience I’ve had messages from fedia.io take anywhere from 20-120 minutes to show up on my mastodon. As admins beef up their servers, but also as excitement tones down and there is less enthusiastic usage, hopefully the problem will resolve for the most part.

    I’m not sure what causes messages to be lost forever vs. just delayed. Maybe Kbin or Lemmy aren’t quite as robust in that? When mastodon was melting down, messages could take 8+ hours to get through, but they seemed to get through. I think your idea about a resync idea is a great one.

    • coffeeisnotlatte@latte.isnot.coffee
      link
      fedilink
      arrow-up
      1
      ·
      1 year ago

      Yeah I started on a dinky little server and now it’s massive… mostly seems to be a memleak or something going on though that’s causing OOM and a massive CPU spike. Anyone know anything? 4GB of RAM getting eaten for breakfast… just had to up it to 8

      • vsis@feddit.cl
        link
        fedilink
        arrow-up
        1
        ·
        1 year ago

        I’m curious. How many users in that instance? I assume that an instance for a few people don’t eat that amount of ram.

  • purpleball@lemmy.tancomps.net
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    I have the same issue. I use multiple accounts across different servers, and get a different subset of comments across each one. Not sure the solution right now.

  • El Gringo Loco@lemmy.donmcgin.com
    link
    fedilink
    English
    arrow-up
    3
    ·
    1 year ago

    I had a similar problem that ended up having to do with my server’s language settings. I didn’t realize you can select more than just “Undetermined” by holding down shift or ctrl. So everything tagged as English didn’t appear until I went back and fixed it. You can read the whole odyssey here: https://lemmy.ml/post/1205767

    • Eddie@lucitt.socialOP
      link
      fedilink
      English
      arrow-up
      0
      ·
      1 year ago

      Ha! Love it when people post troubleshooting in real time. I have both undetermined and english selected, so I don’t think that’s it.

  • kopper [they/them]@lemmy.blahaj.zone
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    I believe the solution is to wait until 0.18 is released and everyone updates to it.

    i am preparing to launch my own (likely single-user) instance and i’m not sure if i should wait until 0.18 proper or just throw the rc and see if that’s enough.

  • jcg@halubilo.social
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    Yep, it’s because of the volume of comments/posts going through the big instances right now, and how many people are subscribed outside of those instances. It’s too much for the server to keep up. I noticed over the last day or two my feed has mostly been Beehaw.org stuff because they don’t seem to be having as hard of a time. It sure is looking like we need more separation like startrek.website, and maybe it was a bad idea to allow communities to just be made by anyone on lemmy.world and sh.itjust.works. Would’ve made more sense for all the users to be on these instances, but the communities hosted elsewhere.

    • Eddie@lucitt.socialOP
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 year ago

      Yeah, I definitely agree that open communities was/is a mistake. If a server is that large, it should be admin only. They can always run polls to gauge interest before making new communities.

      Communities are the biggest problem. One solution would be to make community names more like a federation signature that only allows one community to have that exact name. Example: if lemmy.world has a community called !AITA, and you try to make a community on beehaw with the same !AITA name, it would not allow it and say “sorry that community name has already been registered by another instance”.

      Of course, the major issue with this idea is that one could defederate with lemmy.world, in this example, and make the community name anyway, then refederate. Who would keep the name? That’s why I don’t think this solution is ideal, but it’s fun to share ideas and something to think about.

  • degrix@hqueue.dev
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    I’m seeing this issue primarily with communities hosted on lemmy.ml and lemmy.world. Admittedly, that’s a lot of the active ones at the moment, but for some of the smaller ones I follow, they seem to show up.

  • Coeus@coeus.sbs
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    I’m glad I’m not the only one. I am commenting on this post from my own instance and it says it has 0 replies which I know is wrong. I did only federate with Selfhosted just a few hours ago. Who know how long it will take this post to get back to lemmy.world.

  • poVoq@slrpnk.net
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Its likely not a fault on your end, but overloaded servers on the other side failing to push updates or pushing them more that 10 seconds delayed after which your instance will discard them.

    The latter part could be improved in the codebase I guess, but overloaded severs are just a reality right now, especially lemmy.ml

  • idle@158436977.xyz
    link
    fedilink
    English
    arrow-up
    2
    arrow-down
    1
    ·
    1 year ago

    Thanks for pointing this out, I am just now realizing I am also missing comments. For example this post, I have 7 comments, but the actual post has 10.