I’ve been trying to fix the CPU issues with the database for weeks now and I felt I had gotten close. I ran these migrations manually and the delete query deleted somewhere around 400k rows. Somehow that I’ve been monitoring the CPU for about an hour now and it seems to be behaving. It would spike when I upvoted anything and stay there a while. I don’t want to jinx it but try out the site and let’s see if it stays responsive.

My deepest apologies for the downtime and the irritating slowness of the instance since you all joined.

  • GordieHowesThumb@midwest.social
    link
    fedilink
    English
    arrow-up
    6
    ·
    1 year ago

    The instance has been running great this afternoon/evening, probably the best I’ve seen since I joined. Thank you so much for all your hard work and care!

  • FoxBJK@midwest.social
    link
    fedilink
    English
    arrow-up
    5
    ·
    1 year ago

    Night and day difference compared to yesterday. Even the mobile apps I’m using are more responsive since API calls are coming back quicker.

    I’m a web developer and do some hosting on the side. Not sure how much help I can be but feel free to PM

  • hrimfaxi_work@midwest.social
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    1 year ago

    The effort is much appreciated!

    returning to add that it’s running better than ever for me since coming back up

  • AlligatorBlizzard@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    2
    ·
    1 year ago

    I figure I’ll wait a few weeks to try to apply/reapply to your instance. I tried to apply once and ended up with the spinning circle, no idea if my application went through. I just blocked my first exploding heads group and I hate being federated with them and Burggit (I don’t have NSFW enabled so I haven’t seen any of their stuff but still), but… shit just works here. In a few weeks I figure the growing pains will be sorted out and it’ll be easier to move to another instance. Thanks for all of your hard work maintaining your instance, joining in via federation has been great.

  • b0b89@midwest.social
    link
    fedilink
    English
    arrow-up
    2
    ·
    edit-2
    1 year ago

    No worries don’t feel like you have to keep 99% uptime or anything. I just appreciate that you let us all use your instance.

  • llama@midwest.social
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Thanks for doing the hard work to keep our instance updated and online! Do you have a wish list or fundraising goal? I want to do my part to keep our community sustainable.

  • gdj209@midwest.social
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Appreciate the work you are doing to keep this up for us. I did want to acknowledge that the site is super fast and responsive now!

    • seahorse [Ohio]@midwest.socialOPM
      link
      fedilink
      English
      arrow-up
      3
      ·
      1 year ago

      Thanks! Honestly, this was the most difficult to track software issue I’ve ever done lol. I’m still a bit traumatized. Every time the site takes a half second longer to load my heart skips a beat because like 5 times this issue has seemed to go away but come back quickly.

  • I'm A Different Bird@midwest.social
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Thanks for working to bring everything back up. I’m still getting my bearings here after joining in the wake of the Reddit APIcalypse, and I’m glad you guys are this attentive when there are problems.

    I’ve noticed that I can’t log in to the site in either a mobile or desktop browser. After I put in my user name and password and click Log In, I just get a circle that spins indefinitely. I’ve noticed this in both Firefox and Chrome on Windows, and Firefox on Android. Is this possibly a lingering issue from this morning?