Fixed Unable to load BP library - An item with the same key has already been added. [00202]

Discussion in 'Fixed (Read Only)' started by spanj, May 18, 2022.

  1. Germanicus

    Germanicus Rear Admiral

    Joined:
    Jan 22, 2018
    Messages:
    5,032
    Likes Received:
    8,757
    @spanj
    You are persistent! I'll give you that.:NewThumbsUp::NewWink:
     
    #21
    Pach likes this.
  2. Germanicus

    Germanicus Rear Admiral

    Joined:
    Jan 22, 2018
    Messages:
    5,032
    Likes Received:
    8,757
    Just a thought - Did everyone of you who has this troubles agree to this?
    unknown_2022.05.21-06.21 (2).png
     
    #22
  3. ravien_ff

    ravien_ff Rear Admiral

    Joined:
    Oct 22, 2017
    Messages:
    6,413
    Likes Received:
    12,015
    I did not get a prompt for that recently.
     
    #23
  4. Escarli

    Escarli Rear Admiral

    Joined:
    Dec 13, 2019
    Messages:
    1,314
    Likes Received:
    1,331
    Don't recall getting a prompt but when I check mine it says accepted on 12th May
     
    #24
  5. hot.slot

    hot.slot Ensign

    Joined:
    May 21, 2022
    Messages:
    11
    Likes Received:
    1
    I have similar problems with subscribed workshop blueprints except:

    - I see some subscribed workshop content and can spawn it
    - I have only ONE error message with 'An item with the same key has already been added.'
    - I hve only one item published on my workshop and I can spawn it

    @Admins of the board ... please be so kind and contact me. I might have found a minor security issue here on the board that I dont want to discus in the public. Thx.
     
    #25
  6. SnowdogJJJ

    SnowdogJJJ Commander

    Joined:
    Jun 22, 2020
    Messages:
    118
    Likes Received:
    26
    This has been going on for years, it is very disappointing that the Dev here are unwilling or unable to resolve this problem. IT seems like an indexing problem that needs some code (a program) that can re-index but what do I know.
     
    #26
  7. Taelyn

    Taelyn Administrator Staff Member Community Manager

    • Developer
    • Administrator
    Joined:
    Oct 4, 2021
    Messages:
    739
    Likes Received:
    1,308
    We do not take the easy way out, there is simply nothing we can do, we already checked. If you read steam you will see that many game suffer from the same problem. Then problem is steam and not with us.

    Neither we changed for a long time anything in this part of the code
     
    #27
  8. Taelyn

    Taelyn Administrator Staff Member Community Manager

    • Developer
    • Administrator
    Joined:
    Oct 4, 2021
    Messages:
    739
    Likes Received:
    1,308
    You can send me a message with the issue
     
    #28
    Germanicus and Pach like this.
  9. hot.slot

    hot.slot Ensign

    Joined:
    May 21, 2022
    Messages:
    11
    Likes Received:
    1
    I am not shure that this is an indexing problem. Because some of us have obviously deinstalled and after that reinstalled the game. Also they unsubscribed to all workshop items. But the error remains the same by the looks of it. So the only thing I could imagine would be files that remain on the harddisk even if you reinstall the game.

    I played the game 05/16/2022 and it worked fine. I restarted the game a few times because I was trying out new workshop blueprints. No errors while doing this.
    Then today 05/21/2022 the error showed up. So my guess is that something happened during that time.

    The only thing I am aware of that changed during that time was a patch of the RE 1.7 mod. Is it possible that this could trigger a ID-key-duplication-bug like that? Is here a player affected who plays vanilla only?

    On the other hand ... the bug appears when a safegame is not even loaded. That points out that in theory no mod can be the cause for the bug.

    How is this even possible that an ID can be double loaded at this point of the game?

    Questions over questions ... o_O

    [edit]uploaded 2 logfiles ... of the last working game and the first buggy game[/edit]
     

    Attached Files:

    #29
    Last edited: May 21, 2022
  10. Arthmoor

    Arthmoor Commander

    Joined:
    Sep 30, 2020
    Messages:
    195
    Likes Received:
    141
    Unfortunately the changes they've made to the forum recently are preventing the image from downloading and the thumbnail is too small to tell what's being asked.
     
    #30
  11. hot.slot

    hot.slot Ensign

    Joined:
    May 21, 2022
    Messages:
    11
    Likes Received:
    1
    Reasons for the bug and suggested solutions:

    After several tests and diving further into the log files I am now confident to know what exactly causes the issue ...

    The loading of workshop contents from Steam into Empyrium is kind of database driven. The content Steam handles over to Empyrion is organized pagewise. So Empyrium requests the Steam workshop content page by page as long as pages are present.

    After getting a page of workshop content Empyrium trys to insert the content immediatley into the game. It does not check for duplicated content or otherwise validity before doing this. If an error occures Empyrium stops reading and inserting further content into the game.

    This is exactly what happens here. An error occurs due to duplicated content given from the Steam engine during insertation and Elyrium stops to insert any further content.

    So if the error happens on page 2 of the from Steam overgiven content you will have ingame access to the correctly into Empyrium inserted content of page 1. If the error happens on page 5 you will have ingame access to the content of page 1 to page 4 and so on.

    Suggested solutions:

    1. Steam checks the workshop contents for validity (e.g. duplicates) before handling it over to the game.
    2. Empyrium checks the content for validity (e.g. duplicates) before inserting it into the game for every item and discards only items that does not pass the validity check. Not stopping the process in general just because of that.
    3. Both of it. But one of that alone should fix the problem.
    Btw. there is nothing a user could do about it as far as I am aware. This has to be a solution of the developers (Steam/Eleon). Maybe a walkaround would be to deabo all content - start the game (=cleaning) - abo the workshop content again - start the game (=rebuilding). But I did'nt try it out. This would be to rebuild the workshop content database on the Steam side. I will try it later on and tell you the outcome. ;)

    [edit]fixed some strange misstypings ... sorry for my bad english![/edit]
     
    #31
    Last edited: May 22, 2022
    Pach likes this.
  12. sulusdacor

    sulusdacor Captain

    Joined:
    Nov 27, 2018
    Messages:
    396
    Likes Received:
    673
    For more information see here Bug Report Template

    Build:1.7.9
    Mode: creative

    Reproducibility: last 2 times i uploaded something to the workshop, not risking/testing if it still happens because i do not wanne break more, so not sure here
    Severity: very high

    Summary: uploading a blueprint gets me stuck in the "checking workshop blueprints" loop and unlinking/breaking a bunch of my older steamworkshop blueprints

    Description: i uploaded my blueprint to steam like normal, but the "checking workshop blueprints" with cancel button does not get away. pressing cancel got me out, but opening the blueprint tab brought the checking workshop thing up again too - meaning any blueprints got inaccessible. so i restarted empyrion. upon restart i noticed the console giving me an error and thought nothing of it at the time(similar to screenshot 1). after it i was thinking that maybe more blueprints seems broken then before. i had a few from a while back that had the issue, but it was only a handfull.
    after the workshop upload from today i had the same problem. the "checking workshop blueprints" box did not go away, i restarted empyrion. a few more blueprints got broken, of which i am sure now. these blueprints are already uploaded to steam, but are not recognized anymore by empyrion as being linked to steam. which means i can no longer update these now, my only option would be to reupload them under a new id and with the current situation breaking more in the process. i can still spawn the blueprint ingame, but the steam "regcognition/identification" is gone if that makes sense.
    + to my knowledge there is no way to relink/fix these blueprints, at least when i discovered the few i had in the past i found none.

    Steps to Reproduce:
    upload a blueprint to the workshop i guess?

    Screenshots, Crash Logs, any other Relevant Information or Download links:
    screenshot 1 empyrion_bug_2022_05_22.jpg
    (the argumentexception number is always different, but i get this error everytime i start the game)

    broken blueprints
    broken_blueprints.jpg
    (ones with the questionmark in the right corner below the steam icon are not longer updateable on the workshop)

    edit: thx for the merge, it seems to be the same issue. small addition/clarification in case not clear form above: it breaks my own blueprints, not subscribed blueprints + each upload seems to make it worse. meaning essentially uploading any blueprint to steam at the current time is not worth it.

    edit2: it does affect my subscribed blueprints not showing up too :(
     
    #32
    Last edited: May 22, 2022
  13. Myrmidon

    Myrmidon Rear Admiral

    Joined:
    Mar 26, 2016
    Messages:
    1,729
    Likes Received:
    2,058
    I confirm this also. I checked it last night and only if I copy manually the blueprint folder (/steamapps/workshop/content/383120/) into my local folder (/common/Empyrion - Galactic Survival/Saves/Blueprints/) I can see the blueprint.

    Additional if I add a new blueprint from browser (not steam client) and try to load any save or start a new game the game crashes due to Unity issue. This does not happen today though.

     
    #33
    Last edited: May 22, 2022
  14. hot.slot

    hot.slot Ensign

    Joined:
    May 21, 2022
    Messages:
    11
    Likes Received:
    1
    I am not shure that these bugs are related to each other.

    The orignial topic is related to downloading items from the Steam workshop at the stage of the game start.
    The merged topic is related to UPloading items TO the steam workshop within a running game.

    The merging might bring more confusion than than a win. I think its unrelated!
     
    #34
  15. ravien_ff

    ravien_ff Rear Admiral

    Joined:
    Oct 22, 2017
    Messages:
    6,413
    Likes Received:
    12,015
    It's highly likely they are related as they both started happening at the same time.
     
    #35
  16. hot.slot

    hot.slot Ensign

    Joined:
    May 21, 2022
    Messages:
    11
    Likes Received:
    1
    It might related in terms of a bug inside the Steam database engine. But it is clearly an other bug in my oppinion.

    [edit]If there is no error message like ...
    "22-03:37:25.391 05_37 -LOG- SWS.QueryItems: Requesting AllBlueprintsSubscr page 3
    22-03:37:29.930 05_37 -LOG- SWS.OnQueryCompleted for AllBlueprintsSubscr page 3
    ArgumentException: An item with the same key has already been added. Key: 1597268921
    at System.Collections.Generic.Dictionary`2[TKey,TValue].TryInsert (TKey key, TValue value, System.Collections.Generic.InsertionBehavior behavior) [0x000c1] in <695d1cc93cca45069c528c15c9fdd749>:0
    at System.Collections.Generic.Dictionary`2[TKey,TValue].Add (TKey key, TValue value) [0x00000] in <695d1cc93cca45069c528c15c9fdd749>:0
    at Assembly-CSharp.MethodTypeGroupProvider.SaveToolbox (System.Collections.Generic.List`1[T] , System.Boolean ) [0x00026] in <7f5ef583549a4508933b8ce2251d075c>:0
    at Assembly-CSharp.DeploymentTypeGroupProvider.ListRegistry (Steamworks.SteamUGCQueryCompleted_t , System.Boolean ) [0x00271] in <7f5ef583549a4508933b8ce2251d075c>:0
    at (wrapper delegate-invoke) Steamworks.CallResult`1+APIDispatchDelegate[Steamworks.SteamUGCQueryCompleted_t].invoke_void_T_bool(Steamworks.SteamUGCQueryCompleted_t,bool)
    at Steamworks.CallResult`1[T].OnRunCallResult (System.IntPtr thisptr, System.IntPtr pvParam, System.Boolean bFailed, System.UInt64 hSteamAPICall_) [0x00035] in <3bdaacd4715848b3bb3a9b0e224568be>:0"

    in the logfile then it IS definitely unrelated!
     
    #36
  17. ravien_ff

    ravien_ff Rear Admiral

    Joined:
    Oct 22, 2017
    Messages:
    6,413
    Likes Received:
    12,015
    Well all we can really do is blindly speculate, as we do not have access to either the game's code or Steam's code. If they merged the topics then it's likely they know things we don't as they actually work with the code, not us.
     
    #37
    Monroe and Myrmidon like this.
  18. hot.slot

    hot.slot Ensign

    Joined:
    May 21, 2022
    Messages:
    11
    Likes Received:
    1
    Hopefuly you are right! ;)
     
    #38
  19. Pantera

    Pantera Administrator Staff Member

    • Developer
    • Moderator
    Joined:
    Aug 15, 2016
    Messages:
    3,418
    Likes Received:
    6,106
    A fix for this is currently available in v1.8 B3823 EXP 2:

    - Fixed CoQ at the Main Menu from the steam workshop.
     
    #39
    Pach, Wellingtoon, hot.slot and 3 others like this.
  20. Belamber

    Belamber Ensign

    Joined:
    May 24, 2022
    Messages:
    2
    Likes Received:
    1
    Could you also add a log of which BP was found to be a duplicate if you are performing the validation on your side? Something more than just duplicate key found.
     
    #40
    Monroe likes this.

Share This Page