coffeeisnotlatte 1y ago • 100%
I got march of shamed once because I genuinely forgot, it somehow shortcircuits my brain when I need to wait for approval, thinking I've already paid and walk out after waiting for the person to come tap some buttons :|
Since many people have asked me already, I created a Mastodon here: https://mastodon.social/@latteisnotcoffee You can follow that for server downtime, updates when this server is down etc :)
coffeeisnotlatte 1y ago • 100%
No need for now, if it gets to be more of a handful I will start asking for mods, maybe crowdfund a larger server etc but I suspect it'll be alright :)
coffeeisnotlatte 1y ago • 0%
Aye we're still on 0.17.4, mostly because I was lazy, but it seems to have worked out in this case. I'll give 0.18 a little time to settle before we upgrade
Sorry for the downtime, the server has been moved onto better infrastructure so hopefully it won't go down as frequently in the future
coffeeisnotlatte 1y ago • 100%
That sounds like a particularly horrible idea, there's no way to know. I would take the risk on electronics, not something you actually put into your body.
They killed captcha support in 0.18, which basically negates one of the methods to stop the bots... so if we upgrade, we will likely need to email verification until 0.18.1 is released OR stay on 0.17.4 until 0.18.1 is released where they've promised to bring it back.
coffeeisnotlatte 1y ago • 100%
Not super easily. It can be done by querying the postgresql dabase, but there is no built-in method to do it using the browser interface at the moment. When anyone from any instance does report them, you will see the report.
Do you have an example of a query I could use? I'm a bit rusty with databases :) with an example I can get chatgpt to build me something better
coffeeisnotlatte 1y ago • 100%
I see, occasionally I get reports from local users about something elsewhere from a 'foreign' user... which I can then delete. I assume that's not deleting from their server?
For example I get a report from a local user about a lemmy.ml user with a post in lemmy.world
coffeeisnotlatte 1y ago • 100%
I don't unfortunately, I deliberately don't log that due to some of the sensitive stuff on my own instance (we're China based)
After the bot attacks I've cleaned up and implemented some additional measures thanks to some helpful users, but I'd also like to monitor the situation in case someone from my server decides to go on a spam rampage... Is there a way to: 1) Easily get a list of comments from all my users locally and across the 'verse? 2) If I purge/ban these users, is there a protocol for letting other Lemmy admins know? I assume I have no power to delete things from their instances (just my copy of their instance?)
Bots cleaned, there is now a captcha and I have some additional admin tools. I'm not going into too much detail as the bot maker may be reading :) I will be keeping a close eye on the numbers and patterns over the next few days, so it may close again for a few hours depending on the types of attacks. If anyone sees a latte.isnot.coffee user spamming anywhere on Lemmy please let me know immediately
coffeeisnotlatte 1y ago • 100%
Yup I've got them, luckily 5 or more repeating numbers in their email pretty much identified 99% of them. Would you like me to send the CSV somewhere? 27k+ bots
coffeeisnotlatte 1y ago • 100%
That's okay I found it, luckily there's a pattern here too... I dug up 27k with repeating numbers on emails which is a good start!
coffeeisnotlatte 1y ago • 100%
Huh adminer would definitely be an easier way to do this, do you have the part of the docker-compose you used with the env vars etc?
coffeeisnotlatte 1y ago • 100%
Yeah that's the issue I'm having, someone sent me a postgres command in DM earlier but it does seem to be a bit of a nuke/picking up ordinary users....
Trying to purge them and set up with Lemmy Ansible, I've disabled signups without admin approval for now. I see a postgres container and a password but I'm not very familiar with postgres, I tried psql but can't get access Edit: Also anyone who's de-federated with us, please reconsider. We're a small server with active admin and will get a handle on this, I promise! We had an easy process to sign up for a few days while I got my users over and forgot to turn it off Edit2: Looking much more healthy now, I will put the commands I've used in a comment below
Admin approval will be granted every few hours, not ideal but I need to get a handle on the 28k+ bots that have signed up.
coffeeisnotlatte 1y ago • 100%
Yeah I started on a dinky little server and now it's massive.... mostly seems to be a memleak or something going on though that's causing OOM and a massive CPU spike. Anyone know anything? 4GB of RAM getting eaten for breakfast... just had to up it to 8
coffeeisnotlatte 1y ago • 0%
Damn, I've got to look into that myself. Mine's currently on AWS and costing me a small fortune
coffeeisnotlatte 1y ago • 100%
I just put my instance through cloudflare, it seems okay. I would guess cloudflare won't be that fussed considering it's federated/easily accessible from others.
On 0.17.4, has anyone else noticed this? The last few days the server chewed through 2GB of RAM... then yesterday it chewed through 4GB after an upgrade in about 2 days and now seems to be chewing through about 100MB/hour with no sign of stopping. I put in a bug report but thought I'd ask if anyone else is having the issue too: https://github.com/LemmyNet/lemmy/issues/3183
Seems we have a memory leak in Lemmy, I will report it upstream and see what they say since we have 4GB RAM now and it was fine with 2GB for days and now goes down with 4 over 24 hours :| All I will say is bloody node.js > ./syslog:Jun 18 04:38:38 ip-172-31-33-220 kernel: [142633.319174] Out of memory: Killed process 1349 (node) total-vm:2700484kB, anon-rss:2004100kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:18016kB oom_score_adj:0 Reported upstream, in the meantime I may need to do a quick reboot every 24 hours where the server may be down for 1-2 minutes: https://github.com/LemmyNet/lemmy/issues/3183
coffeeisnotlatte 1y ago • 95%
You could, but the API for Reddit won't work in two weeks... and tbh I like the fact we're building something new here
Server went crazy in CPU and killed itself, looking into it now.
I'm not on either the instance reported from or the instance reported to, I have my own instance. Why am I getting these reports/would care about them?
coffeeisnotlatte 1y ago • 100%
I would, but unfortunately r/jailbreak is closed where I got the instructions :(
coffeeisnotlatte 1y ago • 100%
It's like everyone saw what Twitter did, and thought they could get away with doing the same
coffeeisnotlatte 1y ago • 100%
I could live without youtube for sure, I have more of a Reddit problem than a YouTube problem... but it seems they fixed that for me.
coffeeisnotlatte 1y ago • 100%
Mine is actually also a VPS, my electricity is too unstable to host at home :')
It's pretty light though, 2GB RAM and 2vCPUs and about 10GB of space. It shot up to 9.5GB over a few days as people added more communities, then slowed down a lot. We have ~60 users as of now
coffeeisnotlatte 1y ago • 100%
Regular Apollo still works for now, I've got the modified version on a backup iPhone 8 so let's see if it still works there after the shutdown
This is a general discussion thread for any questions or topics that you feel don't deserve their own thread, or just for random thoughts and comments. The sidebar guidelines apply here too and these threads will be closely moderated, so please keep the discussions civil, and try to keep top-level comments China-related.
As you can see in the screenshot, most communities I put in yesterday (except this one) have zero comments. Any idea why that would be? If I go to the instance itself I see comments