Fixed Insane memory use and then freeze frame unplayable

Discussion in 'Fixed (Read Only)' started by Scotsman, May 15, 2019.

Thread Status:
Not open for further replies.
  1. Scotsman

    Scotsman Ensign

    Joined:
    Dec 25, 2016
    Messages:
    16
    Likes Received:
    10
    Alpha 10 experimental

    worked fine yesterday - now unloadable...windows 7 16gb memory i7 core - and latest nvidea drivers (430.64) on a gtx 970...memory consumption more than doubled and can go as high as 13 GB on load independent of option settings...game eventually loads but unplayable....freeze frame...with memory usage remaining at 10-13 GB. Same issue when generating a new game...seems to use all available memory crawls along until complete and then eventually loads after many minutes but in freeze frame mode and memory usage as outlined above.
     
    #1
  2. SilvRav

    SilvRav Moderator

    • Moderator
    Joined:
    Jan 13, 2017
    Messages:
    539
    Likes Received:
    882
    Have you tried to verify game files? Memory usage should be down for a10 exp as after an hour of playing mine sat at 3.5gb only

    No custom configuration being used?
     
    #2
  3. Scotsman

    Scotsman Ensign

    Joined:
    Dec 25, 2016
    Messages:
    16
    Likes Received:
    10
    Screenshot_2.jpg All verified correct - did an uninstall and reinstall on a different drive - same story. This is typical but memory usage on my system can run to 13 GB which is basically everything available. CPU usage remains at 97-99% and memory usage is stuck that high...

    I tried custom difficulty on this with reduced food consumption on a new game...as well as generic with no changes...medium or large planet is the same....uses all available memory and CPU.
     
    #3
    Last edited: May 15, 2019
  4. Scotsman

    Scotsman Ensign

    Joined:
    Dec 25, 2016
    Messages:
    16
    Likes Received:
    10
    Screenshot_9.jpg Screenshot_9.jpg Screenshot_11.jpg View attachment 59376 View attachment 59377
    Standard game generation attached...no custom settings...loading an pre-existing game generated under alpha 10 is the same story. Game will eventually load or new system generation will eventually complete but only with incredible memory usage and game is basically freeze frame and unplayable.
     
    #4
  5. Germanicus

    Germanicus Rear Admiral

    Joined:
    Jan 22, 2018
    Messages:
    4,491
    Likes Received:
    8,521
    How about disabling those 10 or more Google Chromes that are running ? Google likes it to sneak in and send info back to "Papa".

    To your engine
    I run a Win 8.1, 16GB RAM, GTX 780 at full "best" Graphic solution and come barely above 7GB even after playing 5 hours.
    And Win 8.1 is much worse to Win 7
     
    #5
  6. Scotsman

    Scotsman Ensign

    Joined:
    Dec 25, 2016
    Messages:
    16
    Likes Received:
    10
    I killed google completely...no change... that's not it..
     
    #6
  7. Scotsman

    Scotsman Ensign

    Joined:
    Dec 25, 2016
    Messages:
    16
    Likes Received:
    10
    Just tried a completely standard new game generation...everything killed except steam and the game...memory usage less than 16%. Same story...game starts at around 5 Gb...click to generate a new standard survival game...CPU jumps to 99% and memory to 10 GB or over...and stays there...when the game finally comes around its freeze frame mode...unplayable...and memory stays in the 10-13 gb range and CPU at 99%. Smells like a memory leak to me... again this is on a windows 7 I7 16 GB system with a GTX 970 and the latest driver (430.64)
     
    #7
  8. Na_Palm

    Na_Palm Captain

    Joined:
    Mar 29, 2017
    Messages:
    246
    Likes Received:
    1,422
    As I'am also on win 7 Service pack 1 and a GTX 970, driver version 416.34, i tried to verify this. Processor is an AMD Phenom II X4 965 at 3.4 GHz and 12 GB of physical RAM.
    No custom config.ecf

    Game startup:
    Zwischenablage-4.jpg

    Newly created game:
    Zwischenablage-5.jpg
    back to mainmenu:
    Zwischenablage-6.jpg

    So the memory usage is higher as the mentioned 3.5 gb by SilvRav, almost as high as Scotsman observed. CPU on the other side is completly fine on my side. Could'nt observe a Freeze frame mode, tend to say it is well playable on my end...
     
    #8
  9. Scotsman

    Scotsman Ensign

    Joined:
    Dec 25, 2016
    Messages:
    16
    Likes Received:
    10
    Love the new feature set but if it renders a game that was playing fine with no issues unplayable, then its obvious something was missed in Q&A. Reading some test posts it seems like the update is was tested primarily on windows 8? I would humble suggest it would be a good idea to keep a reference machine handy for test on each flavor of windows to confirm you haven't created an exe that will only run on the variants you tested. The game had that problem previously with windows 10. For now that means 7,8, and 10 unfortunately...its that or settle on 10 and leave everyone else in the dust and force an upgrade to ten in favor of resource usage.

    You could also insure you have all flavors of windows available in the QA test group.

    This isn't an environment issue...its something with the exe for sure.
     
    #9
  10. Pantera

    Pantera Administrator Staff Member

    • Developer
    • Moderator
    Joined:
    Aug 15, 2016
    Messages:
    3,249
    Likes Received:
    5,708
    That's not true all versions of windows are checked.
    I have not seen any such high memory usage or CPU usage myself so far.
    I have win 10 & 7 both running the game now with less than 5gb of ram being used on both when the client is running in a new game.

    Just to ask what video settings are you using ?
     
    #10
  11. Taelyn

    Taelyn Guest

    Iam testing things on windows 10 :) some others are too. Were running all kinds of machines
     
    #11
  12. Scotsman

    Scotsman Ensign

    Joined:
    Dec 25, 2016
    Messages:
    16
    Likes Received:
    10
    windows 7?
     
    #12
  13. Pantera

    Pantera Administrator Staff Member

    • Developer
    • Moderator
    Joined:
    Aug 15, 2016
    Messages:
    3,249
    Likes Received:
    5,708
    Yes windows 7 running on it's own machine with another member of the team running win7 also.

     
    #13
  14. Pach

    Pach Rear Admiral

    Joined:
    Dec 16, 2017
    Messages:
    588
    Likes Received:
    702
    I'm also running Win7.

    I started EGS, and it peaked at 8G when I started a new game.

    Didn't try playing it, but my PC might blink a few times at 8G, but shouldn't care (but other's might).
     
    #14
    Germanicus likes this.
  15. Scotsman

    Scotsman Ensign

    Joined:
    Dec 25, 2016
    Messages:
    16
    Likes Received:
    10
    I wouldn't care if it was playable...my favorite steam game...but running all theway to 13 Gb says there is a problem with the exe or in the way the exe is doing things with the video card. Are the others experiencing this also on nvidea cards...particularly GTX?
     
    #15
  16. Germanicus

    Germanicus Rear Admiral

    Joined:
    Jan 22, 2018
    Messages:
    4,491
    Likes Received:
    8,521
    Nope to NVIDIA, Game is running on a GTX 780M. Sure it takes 7GB RAM but no other issues.
     
    #16
  17. Germanicus

    Germanicus Rear Admiral

    Joined:
    Jan 22, 2018
    Messages:
    4,491
    Likes Received:
    8,521
    Resource use while in game
    Recource.jpg
     
    #17
  18. Kard

    Kard Commander

    Joined:
    Oct 22, 2017
    Messages:
    26
    Likes Received:
    73
    Just did a memory check on a Win7Pro sp1 machine, using A10 b2450. Values below are for the .exe only, do not include Steam or the UnityCrashLogHelperThingy. Intel i7 [email protected]
    Start game (.exe), wait for main menu. Ramps from 0gb usage to 3.42 gb
    Load existing gamesave, ramps from 3.42 gb to 6.1 gb at time of playload.
    During gameplay (over an hour of time), hovers between 7-8 gb usage.
     
    #18
  19. Scotsman

    Scotsman Ensign

    Joined:
    Dec 25, 2016
    Messages:
    16
    Likes Received:
    10
    logfile - some libs not found and this was on a clean reinstall of Alpha 10 on the existing steam directory ...notice that this is with DirectX11 installed...planet generation runs fine but memory explodes as structures begins. When game begins memory used is 12-13gb and I can hear sound etc but its freeze frame video.

    Initialize engine version: 2018.3.14f1 (d0e9f15437b1)
    GfxDevice: creating device client; threaded=1
    Direct3D:
    Version: Direct3D 11.0 [level 11.0]
    Renderer: Software Adapter (ID=0x0)
    Vendor:
    VRAM: 8191 MB
    Driver: 26.21.14.3064
    Begin MonoManager ReloadAssembly
    - Completed reload, in 0.337 seconds
    <RI> Initializing input.

    <RI> Input initialized.

    <RI> Initialized touch support.

    UnloadTime: 0.615520 ms
    17-22:00:56.969 16_00 -LOG- *************************************************************************
    17-22:00:56.992 16_00 -LOG- Empyrion - Galactic Survival
    17-22:00:56.992 16_00 -LOG- Version: Experimental 10.0.1
    17-22:00:56.992 16_00 -LOG- Build: 2450
    17-22:00:56.992 16_00 -LOG- Platform: Win, 64 Bit
    17-22:00:56.992 16_00 -LOG- OS: Windows 7 (6.1.0) 64bit
    17-22:00:56.992 16_00 -LOG- DRAM: 16384
    17-22:00:56.993 16_00 -LOG- CPU: Intel(R) Core(TM) i7-4790K CPU @ 4.00GHz
    17-22:00:56.993 16_00 -LOG- Freq: 3997
    17-22:00:56.993 16_00 -LOG- Cores: 8
    17-22:00:56.993 16_00 -LOG- Gfx: Direct3D 11.0 [level 11.0]
    17-22:00:56.993 16_00 -LOG- VRAM: 8191
    17-22:00:56.994 16_00 -LOG- SL: 5
    17-22:00:56.994 16_00 -LOG- Force DX9: False
    17-22:00:56.994 16_00 -LOG- Instancing: True
    17-22:00:56.995 16_00 -LOG- TimeZone: -06:00
    17-22:00:56.995 16_00 -LOG- Culture: en-US
    17-22:00:56.995 16_00 -LOG- Last build: 2450
    17-22:00:56.997 16_00 -LOG- Build: Release (nodeCache)
    17-22:00:56.997 16_00 -LOG- *************************************************************************
    Setting up 4 worker threads for Enlighten.
    Thread -> id: 3744 -> priority: 1
    Thread -> id: 23e0 -> priority: 1
    Thread -> id: 23dc -> priority: 1
    Thread -> id: 300c -> priority: 1
    Unloading 4 Unused Serialized files (Serialized files now loaded: 0)
    UnloadTime: 2.799683 ms
    17-22:00:57.691 16_00 -LOG- EAC: Not configured
    17-22:01:00.517 16_01 -LOG- Args: Client/Empyrion.exe -popupwindow -logFile ../Logs/2450/Client_190517-160052-49.log

    Unloading 387 unused Assets to reduce memory usage. Loaded Objects now: 4365.
    Total: 3.513820 ms (FindLiveObjects: 0.288421 ms CreateObjectMapping: 0.167264 ms MarkObjects: 2.910083 ms DeleteObjects: 0.147797 ms)

    Searching for compatible XInput library...
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libxinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libxinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libxinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libxinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libxinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libxinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/xinput1_4
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libxinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libxinput1_4.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libxinput1_4.dll
    Found Xinput1_3.dll.
    Initializing with custom id:

    (Filename: C:\buildslave\unity\build\Runtime/Export/Debug.bindings.h Line: 45)

    17-22:01:05.445 16_01 -LOG- Local player 76561198007896516/'derek.ward'
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libc
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libc.dll
    Fallback handler could not load library C:/Program Files (x86)/Steam/steamapps/common/Empyrion - Galactic Survival/Client/Empyrion_Data/Mono/libc
    17-22:01:06.574 16_01 -LOG- SWS.QueryItems: Requesting AllBlueprintsSubscr page 2
    17-22:01:10.604 16_01 -LOG- SWS.OnQueryCompleted for AllBlueprintsSubscr page 2
    17-22:01:10.607 16_01 -LOG- SWS.QueryItems: Requesting AllBlueprintsSubscr page 3
    17-22:01:20.198 16_01 -LOG- SWS.OnQueryCompleted for AllBlueprintsSubscr page 3
    17-22:01:20.201 16_01 -LOG- SWS.QueryItems: Requesting AllBlueprintsSubscr page 4
    17-22:01:20.228 16_01 -LOG- Loading override ecf file 'C:\Program Files (x86)\Steam\steamapps\common\Empyrion - Galactic Survival\Client/../Content/Configuration/Config.ecf'
    17-22:01:20.269 16_01 -WRN- Config.ecf file not used because of wrong version
    WARNING: Shader Unsupported: 'Hidden/Nature/Terrain/Utilities' - All passes removed
    ERROR: Shader Shader is not supported on this GPU (none of subshaders/fallbacks are suitable)WARNING: Shader Unsupported: 'Hidden/Nature/Terrain/Utilities' - Setting to default shader.
    Shader 'Nature/Terrain/Diffuse': dependency 'Tree0' shader 'Hidden/TerrainEngine/BillboardTree' not found
    17-22:01:22.041 16_01 -LOG- SWS.OnQueryCompleted for AllBlueprintsSubscr page 4
    17-22:01:50.271 16_01 -LOG- Voxelizing took 647ms, voxels=208235, shapes=1232, mem=1085kB
    17-22:02:06.801 16_02 -LOG- GameOptions: Using dataset 'SP, Survival' for condition 'Survival, SP'
    17-22:02:10.503 16_02 -LOG- Starting SP/MP game
    17-22:02:10.505 16_02 -LOG- Started a new game
    17-22:02:10.542 16_02 -LOG- GameOptions: Using dataset 'SP, Survival' for condition 'Survival, SP'
    17-22:02:10.880 16_02 -LOG- Init: game=NewGame, mode=captionEnabled, global seed=220965, playfield=Andralor
    17-22:02:14.570 16_02 -LOG- [PlanetGen] Total planet generation Andralor (TemperateStarter) size 3 took 3496ms !!! Stamp DB is included in loading time !!!
    17-22:02:15.013 16_02 -LOG- [PlanetGen] Total planet generation Andralor Moon (Barren) size 2 took 420ms
    17-22:02:16.294 16_02 -LOG- [PlanetGen] Total planet generation Ghorn (Snow) size 3 took 1207ms
    17-22:02:17.641 16_02 -LOG- [PlanetGen] Total planet generation Liackoum (Snow) size 3 took 1263ms
    17-22:02:18.956 16_02 -LOG- [PlanetGen] Total planet generation Liackoum Moon (Barren) size 3 took 1285ms
    17-22:02:20.136 16_02 -LOG- [PlanetGen] Total planet generation Sarva (Alien) size 3 took 1090ms
    17-22:02:21.623 16_02 -LOG- [PlanetGen] Total planet generation Alanor (Arid) size 3 took 1416ms
    17-22:02:22.040 16_02 -LOG- [PlanetGen] Total planet generation Alanor Moon (Lava) size 2 took 397ms
    17-22:02:23.470 16_02 -LOG- [PlanetGen] Total planet generation Azelja (Barren) size 3 took 1311ms
    17-22:02:24.776 16_02 -LOG- [PlanetGen] Total planet generation Azelja Moon (Barren) size 3 took 1285ms
    17-22:02:26.635 16_02 -LOG- [PlanetGen] Total planet generation Adelon (Desert) size 4 took 1778ms
    17-22:02:28.553 16_02 -LOG- [PlanetGen] Total planet generation Kondasamy (Lava) size 4 took 1855ms
    17-22:02:29.096 16_02 -LOG- [PlanetGen] Total planet generation Kondasamy Moon (Nascent) size 2 took 460ms
    17-22:02:30.783 16_02 -LOG- [PlanetGen] Total planet generation Tazuma (Ocean) size 4 took 1545ms
    17-22:02:31.261 16_02 -LOG- [PlanetGen] Total planet generation Tazuma Moon (Lava) size 2 took 429ms
    17-22:02:34.677 16_02 -LOG- [PlanetGen] Total planet generation Cauray (Temperate) size 5 took 3306ms
    17-22:02:35.106 16_02 -LOG- [PlanetGen] Total planet generation Cauray Moon (Lava) size 2 took 407ms
    17-22:02:36.660 16_02 -LOG- [PlanetGen] Total planet generation Phialtas (Swamp) size 3 took 1451ms
    17-22:02:36.709 16_02 -LOG- Loading playfield 'Andralor'
    17-22:02:36.726 16_02 -LOG- RandomPlacer: StartBiome center: -350, 350, planet size class: 3
    17-22:02:39.297 16_02 -LOG- [SSGUIPoi] RandomPlacer PlacePois: 9 of 119 POIs could not be placed: BAW_HAVOC (Wreckage), BA_TribalDefense_T1 (TribalDefence), BA_TribalArmedOutpost (TribalDefence), BA_PolarisSecurity2 (PolarisDefence), BA_Tribal-HutCrops01 (TribalField), BA_Tribal-HutCrops01 (TribalField), BA_PolarisSmelter (PolarisIndustrialAux), BA_PolarisSecurity1 (PolarisDefence), BA_PolarisSecurity2 (PolarisDefence),
    17-22:02:40.074 16_02 -LOG- Playfield 'Andralor' with playfield seed 619416 loaded (3364 ms)
    Unloading 5 Unused Serialized files (Serialized files now loaded: 3)

    Unloading 37519 unused Assets to reduce memory usage. Loaded Objects now: 251061.
    Total: 822.317702 ms (FindLiveObjects: 66.713149 ms CreateObjectMapping: 65.359670 ms MarkObjects: 653.450693 ms DeleteObjects: 36.793935 ms)
     
    #19
  20. jlego

    jlego Captain

    Joined:
    Oct 18, 2016
    Messages:
    81
    Likes Received:
    194
    Not able to reproduce this either on build 2450. I'm using Best settings, but with Shadows, Antialiasing and SSAO turned down a notch (full texture resolution). I'm running Windows 10. Graphics card is a GTX 970 (factory overclocked) with Game Ready drivers version 419.67, but also updated to latest 430.64 for testing this (I'm a bit lazy with keeping my drivers updated ;) ). CPU/RAM is an i3-6100 and 24GB. CPU usage never goes above 65% no matter what it's doing and is often well below this. On an existing game, RAM usage peaks at ~7.5GB (although it spends more time below 7GB). Starting a new game, it peaks to a little over 5GB by the time the playfield loads. I even tried the same seed as in the last log you posted, and that didn't make any difference.

    Any other games (especially Unity ones) you can test to see if the memory usage is higher than it should be? Does the issue happen on the stable branch (9.x)? Have you tried a clean reinstall of your Game Ready drivers?
     
    #20
Thread Status:
Not open for further replies.

Share This Page