- Joined
- Jan 1, 2001
- Messages
- 60,159
Dear active players, you are safe.
But, ..
The purge is coming.
Okay, that totally sounded scary, but .. let me explain.
We have never tried to delete player data, accounts, builds, world, etc. And we don't really (really sorta) plan on doing this. For example, we kept /legacy, and we still have /general, and with 1.17 we will add /wild. And start our next season.
A decade has passed, and many thousands of players have checked the server out. But, we're not always good enough (insert rip music here).
And this leads to a lot of data, a lot of log files, a lot of databases with data inside them, and a lot of archives, and a lot of backups, etc. Yeah terabytes of data are collecting over the last decade.
This data includes user who have joined the server, but then left. Or who have joined, but got banned. Orrrrr, who has played for 15 minutes, this turned them into a full fledged account, but then they leave and never return.
There are plugins that we don't use anymore, and we stored this data.
There are region files to track progress for jobs, mmo, accounts, .. annnnd we don't have to anymore.
There are players with 0 levels in mcMMO, but we still have their data.
And on and on and on.
Would we not improve our server if we purge this? THEEE BIGG PURRGEEE... (dramatic music)
Yes, we would, the short answer is.
Okay, let's dive into that.
If we have less data for a plugin to load, it loads faster during startup.
If there are less log files and archives to manage, we have more drive space. This benefits us with server management. We are down a lot faster.
If we have less data to backup because the overall footprint of the servers is less on disk, we are offline faster during manual backups, and daily restarts.
Yes, I think that benefits us. We can play harder faster stronger!!! (dramatic music starts again and youtube pvp clips fill the screen... ok okay calm down floris).
Every little bit helps, especially when Mojang loves to introduce new mobs, new tiles, new features, new entities, new blocks, more data, bigger chunks, HIGHER WORLds, And Crazier FEaturUSR.ss. (faints).. I can't keep up.. but, I can help out!
So, after a decade, that's ten years! After TEEEEN years, we are finally ready to say: You know what, YOU. ... KNOW .. WHAT !! Let's just purge some data.
Let's go and collect a list of things that we 'have', and see what we can do to improve on it.
Do we need 7 years of backups? Yes, yes we do! There might be worlds in there that we don't use today, but we might still wish to import.. Okay, wait, that means we have to do that first, let's make a todo item to import things so it lasts forever, and then purge that backup. Okay, now we are building a timeline.
Do we need 5+ years of mcMMO data on users who haven't played in more than 5 years? No, probably not. Let's make a test server, learn the purge commands and see what we can do. Analyze the data and see how it goes. If this goes well, let's make a todo item to clean up mcMMO player data. Will this affect active players with levels? No, it shouldn't! In fact, there's less data to load during start up, during them joining the server, writing to disk, organizing, and less chance of corruption. EXCELLENT: Let's add this one to the list to do.
And we go through the list of things that we have, and make logical decisions. And call this (wait for it: ) THE PURGE !!!!
This year we will check out which databases we have archived that we no longer need today or in the future. For example rollback data from 5 years ago: We can purge that. Or a backup from a world we will never use again: Let's review that and then act on it. And go through plugins who also have their own backups - at that point we're just making backups of backups, and have an archive of backups with all ... yeah, no need to do that. We can clean that up (but make sure we understand we have still what we really need).
We will not promise that 1.17 or 1.18 in the future will happen, we are just working towards it. We will not promise that it will run smoother than 1.16 when we're done, we can't control what Mojang does. But we CAN make a difference by controlling the accounts and data, backups, archives, etc. And making space for the future means it might run the best it can with what we have.
In regards to accounts. Our spawn is very little, we will improve on it, and we will work on upping the performance so repawning or joining the server for the first time will be a tiny bit smoother. But .. what we will also do: That world is now over 3 GB big, mainly because it holds thousands of accounts from players - including around 500+ of players who haven't joined in 5 years. That's just kind of crazy. It's time to not only purge that but to work on some 'policy changes'
Policy changes:
Maybe we will be more open to frequent purging (not once every ten years)
- We can purge certain mob types more often.
- We can purge accounts that are super duper mega inactive more often.
- We could consider purging certain chunk data (without losing builds) a bit more often.
- We can organize plugins and their data more frequently.
- We can announce clearing of items and angry mobs in active chunks more frequently.
- We can nerf plugins, nerf the mobs and item spawn, tiles and redstone per chunks etc.
But don't worry: WE LOVE YOUR GAMEPLAY; why would we ruin THAT, right? So, this nerfing is about the top 1% that adds the most annoying lag to the game. Who needs 500 chickens around them. If the average is 150 per player for example for x amount of chunks in y time. Then we can consider putting a cap on 200, for x chunks over y time, and make the time a little shorter. This means 95% won't notice a difference, but the people causing the most lag with their chickens will. And that's okay, they can still have loads of chickens, but.. it's not super crazy anymore.
And that's just one example; we can do a million t.. okay maybe like 20, but.. we can do a lot to 'tweak' and 'nitpick' to improve performance while keeping 99% of the experience.
And you know what! I think all the little seconds here and there means that we have more space for updates like 1.17 and 1.18, and that your experience is just a bit better while you live stream, play, record, or hang out. Compared to us going 'oh well whatever', and not doing anything.
We will use this thread to give heads-ups on bigger purges, or we will once in a while inform you of some changes that happened Subscribe to the thread, so you don't miss out.
And if you are worried about GETTING PURGED !!!.. don't worry, just read this thread, or ask us questions, or ya know, play on the server. Active players .. they'reeee finnnneee.. Your builds, accounts, progress, it will all be there.
See, it's not that bad, but.. yes, for once - after a decade - how about we start cleaning up a little bit for your benefit
But, ..
The purge is coming.
Okay, that totally sounded scary, but .. let me explain.
We have never tried to delete player data, accounts, builds, world, etc. And we don't really (really sorta) plan on doing this. For example, we kept /legacy, and we still have /general, and with 1.17 we will add /wild. And start our next season.
A decade has passed, and many thousands of players have checked the server out. But, we're not always good enough (insert rip music here).
And this leads to a lot of data, a lot of log files, a lot of databases with data inside them, and a lot of archives, and a lot of backups, etc. Yeah terabytes of data are collecting over the last decade.
This data includes user who have joined the server, but then left. Or who have joined, but got banned. Orrrrr, who has played for 15 minutes, this turned them into a full fledged account, but then they leave and never return.
There are plugins that we don't use anymore, and we stored this data.
There are region files to track progress for jobs, mmo, accounts, .. annnnd we don't have to anymore.
There are players with 0 levels in mcMMO, but we still have their data.
And on and on and on.
Would we not improve our server if we purge this? THEEE BIGG PURRGEEE... (dramatic music)
Yes, we would, the short answer is.
Okay, let's dive into that.
If we have less data for a plugin to load, it loads faster during startup.
If there are less log files and archives to manage, we have more drive space. This benefits us with server management. We are down a lot faster.
If we have less data to backup because the overall footprint of the servers is less on disk, we are offline faster during manual backups, and daily restarts.
Yes, I think that benefits us. We can play harder faster stronger!!! (dramatic music starts again and youtube pvp clips fill the screen... ok okay calm down floris).
Every little bit helps, especially when Mojang loves to introduce new mobs, new tiles, new features, new entities, new blocks, more data, bigger chunks, HIGHER WORLds, And Crazier FEaturUSR.ss. (faints).. I can't keep up.. but, I can help out!
So, after a decade, that's ten years! After TEEEEN years, we are finally ready to say: You know what, YOU. ... KNOW .. WHAT !! Let's just purge some data.
Let's go and collect a list of things that we 'have', and see what we can do to improve on it.
Do we need 7 years of backups? Yes, yes we do! There might be worlds in there that we don't use today, but we might still wish to import.. Okay, wait, that means we have to do that first, let's make a todo item to import things so it lasts forever, and then purge that backup. Okay, now we are building a timeline.
Do we need 5+ years of mcMMO data on users who haven't played in more than 5 years? No, probably not. Let's make a test server, learn the purge commands and see what we can do. Analyze the data and see how it goes. If this goes well, let's make a todo item to clean up mcMMO player data. Will this affect active players with levels? No, it shouldn't! In fact, there's less data to load during start up, during them joining the server, writing to disk, organizing, and less chance of corruption. EXCELLENT: Let's add this one to the list to do.
And we go through the list of things that we have, and make logical decisions. And call this (wait for it: ) THE PURGE !!!!
This year we will check out which databases we have archived that we no longer need today or in the future. For example rollback data from 5 years ago: We can purge that. Or a backup from a world we will never use again: Let's review that and then act on it. And go through plugins who also have their own backups - at that point we're just making backups of backups, and have an archive of backups with all ... yeah, no need to do that. We can clean that up (but make sure we understand we have still what we really need).
We will not promise that 1.17 or 1.18 in the future will happen, we are just working towards it. We will not promise that it will run smoother than 1.16 when we're done, we can't control what Mojang does. But we CAN make a difference by controlling the accounts and data, backups, archives, etc. And making space for the future means it might run the best it can with what we have.
In regards to accounts. Our spawn is very little, we will improve on it, and we will work on upping the performance so repawning or joining the server for the first time will be a tiny bit smoother. But .. what we will also do: That world is now over 3 GB big, mainly because it holds thousands of accounts from players - including around 500+ of players who haven't joined in 5 years. That's just kind of crazy. It's time to not only purge that but to work on some 'policy changes'
Policy changes:
Maybe we will be more open to frequent purging (not once every ten years)
- We can purge certain mob types more often.
- We can purge accounts that are super duper mega inactive more often.
- We could consider purging certain chunk data (without losing builds) a bit more often.
- We can organize plugins and their data more frequently.
- We can announce clearing of items and angry mobs in active chunks more frequently.
- We can nerf plugins, nerf the mobs and item spawn, tiles and redstone per chunks etc.
But don't worry: WE LOVE YOUR GAMEPLAY; why would we ruin THAT, right? So, this nerfing is about the top 1% that adds the most annoying lag to the game. Who needs 500 chickens around them. If the average is 150 per player for example for x amount of chunks in y time. Then we can consider putting a cap on 200, for x chunks over y time, and make the time a little shorter. This means 95% won't notice a difference, but the people causing the most lag with their chickens will. And that's okay, they can still have loads of chickens, but.. it's not super crazy anymore.
And that's just one example; we can do a million t.. okay maybe like 20, but.. we can do a lot to 'tweak' and 'nitpick' to improve performance while keeping 99% of the experience.
And you know what! I think all the little seconds here and there means that we have more space for updates like 1.17 and 1.18, and that your experience is just a bit better while you live stream, play, record, or hang out. Compared to us going 'oh well whatever', and not doing anything.
We will use this thread to give heads-ups on bigger purges, or we will once in a while inform you of some changes that happened Subscribe to the thread, so you don't miss out.
And if you are worried about GETTING PURGED !!!.. don't worry, just read this thread, or ask us questions, or ya know, play on the server. Active players .. they'reeee finnnneee.. Your builds, accounts, progress, it will all be there.
See, it's not that bad, but.. yes, for once - after a decade - how about we start cleaning up a little bit for your benefit
