Jump to content

Welcome to the Forum!

The best place to exchange builds and ideas! Vote for the best ideas and suggestions here.

Join the Avorion Discord!

Connect with other passionate players and talk about the latest news.
Discord

Update 2.0 Out Now!

Update 2.0 now available! Check out the ton of QoL Features, improvements, captains, new commands and reworked UI!

Server lockup/crash


DarkJester
 Share

Recommended Posts

Hi koonschi,

 

Thanks to the hang reporter I've gotten some valuable data and identified some potential issues causing the hang. Please try it out and tell me if it still happens!

I've beaten the guardian twice (and salvaged one time) in a row now, no crashes to report. Seems like everything is working properly now.

 

Enjoy your weekend and Merry Christmas.

Link to comment
Share on other sites

Sorry, it took a little longer to crash:

2018-12-21 16-20-11| Sending crash report ... 
2018-12-21 16-20-13| Crash report sent successfully!
2018-12-21 16-20-13| Hang of at least 30 seconds detected, sending stack trace
2018-12-21 16-20-48| Sending crash report ... 
2018-12-21 16-20-50| Crash report sent successfully!
2018-12-21 16-20-50| Hang of at least 30 seconds detected, sending stack trace
2018-12-21 16-21-23| Sending crash report ... 
2018-12-21 16-21-24| Crash report sent successfully!
2018-12-21 16-21-24| Hang of at least 30 seconds detected, sending stack trace
2018-12-21 16-21-57| Sending crash report ... 
2018-12-21 16-21-59| Crash report sent successfully!
2018-12-21 16-21-59| Hang of at least 30 seconds detected, sending stack trace
2018-12-21 16-22-32| Sending crash report ... 
2018-12-21 16-22-32| Crash report sent successfully!
2018-12-21 16-22-32| Hang of at least 30 seconds detected, sending stack trace
2018-12-21 16-23-06| Sending crash report ... 
2018-12-21 16-23-07| Crash report sent successfully!
2018-12-21 16-23-07| Hang of at least 30 seconds detected, sending stack trace
2018-12-21 16-23-41| Sending crash report ... 
2018-12-21 16-23-42| Crash report sent successfully!
2018-12-21 16-23-42| Hang of at least 30 seconds detected, sending stack trace
2018-12-21 16-23-55| Received valid shutdown message, shutting down.
2018-12-21 16-24-16| Sending crash report ... 
2018-12-21 16-24-17| Crash report sent successfully!
2018-12-21 16-24-17| Hang of at least 30 seconds detected, sending stack trace
2018-12-21 16-24-52| Sending crash report ... 
2018-12-21 16-24-53| Crash report sent successfully!
2018-12-21 16-24-53| Hang of at least 30 seconds detected, sending stack trace
2018-12-21 16-25-27| Sending crash report ... 
2018-12-21 16-25-28| Crash report sent successfully!
2018-12-21 16-25-28| Hang of at least 30 seconds detected, sending stack trace

The server is still running according to "top":

torsten@debian:~/.avorion/galaxies/avorion_galaxy$ top

top - 16:28:41 up  6:36,  1 user,  load average: 5,90, 5,10, 3,98
Tasks: 183 total,   3 running, 180 sleeping,   0 stopped,   0 zombie
%Cpu(s): 89,0 us,  9,6 sy,  0,0 ni,  1,4 id,  0,0 wa,  0,0 hi,  0,0 si,  0,0 st
MiB Mem :   7924,1 total,    594,5 free,   5505,9 used,   1823,7 buff/cache
MiB Swap:   1906,1 total,   1906,1 free,      0,0 used.   1955,7 avail Mem 

  PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                                                                                  
3881 torsten   20   0 1928696 596588  53884 S 294,1   7,4  76:37.00 AvorionServer                                                                                                            
  845 root      20   0  954392 137604  98012 R  29,4   1,7  34:44.12 Xorg                                                                                                                     
3820 torsten   20   0 4529604   1,6g 106088 S  17,6  20,6 183:06.14 Avorion 

 

Link to comment
Share on other sites

Hi koonschi,

 

Can you post the beginning of the log as well? I've set a few patches live, I need to know what version you have exactly.

2018-12-21 13-09-05| Avorion server Beta 0.20.2 r13560 ea7d01cb9b83 running on Debian GNU/Linux buster/sid starting up in "/home/torsten/.avorion/galaxies/avorion_galaxy" 

Link to comment
Share on other sites

  • 2 weeks later...
  • Developer
Out of curiosity, if dumb question, my bad, but have you guys done so with "weakupdate=false" on a dedicated server?

Haven't tried that yet, and I can only seriously, seriously discourage you from doing so if you want reliable server performance. Please reenable weak updates and report if it still happens.

Link to comment
Share on other sites

  • Developer

Posting the reply from another thread to keep you guys updated: I found the issue and the fix will go live with the next update.

 

The issue is a deadlock in a reworked callback system we introduced for map command feedback. Whenever some stats of ships change, a callback is sent and there was a chance for a deadlock in those. I actually only managed to reliably reproduce it while looking at another issue I saw when I was testing MRT's save.

 

The hang is not related to antismuggle, the ivec3 issue, weakupdate, mods, tracing, AI Faction with index 0, or invoking "exists" in "".

It's actually completely random due to parallel execution and in a completely different subsystem.

Link to comment
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now
 Share

×
×
  • Create New...