Launchbox video issue

[Jmricher]

Hi

since yesterday most video files are downloaded 0 bytes. 
 

I’ve been able to dl a few of them this morning but most of them are empty. 
 

need help please 

[Circo]

3 hours ago, Bitstorm said:

4 mins just to open the tool, logon and download a list of available systems/art types, this is very long.  If this not considered that abnormal, your API definitely needs huge optimization.  Is your server taking that much of a beating during weekends?

Right now I'm getting much shorter times for sync app: about 50 secs startup and 50 secs for downloads (full re-download of the very same 80 files set as earlier), but the pre-process is still very long.

From LaunchBox, querying against a single rom title (Super Mario World for SNES) finds 25 artworks instantly from LBGD then queries EmuMovies for 4.5 mins before getting results (for a single rom, ouch!).

So EmuMovies Sync app does have some delays querying the API (looks like processing on the API server), but from LauchBox it's much worse.

Can you suggest some other 3rd party apps supporting EmuMovies API for comparison?

-EDIT- trace files sent, ref: Support request #9707.

Actually, I was answering from my cell phone and I was incorrect.  This is crazy slow and not at all normal. We have finally isolated the issue and what was initially causing the error with Launchbox has been overloading the CPU causing search times to skyrocket. 

We have a round of fixes being deployed tomorrow that should get everything operating normally.  

 

[Circo]

Anyone still having issues?

[Evil]

Hi Circo, I'm on version 12.9 of Launchbox and when I try to download any media with Emumovies it keeps taking a long time to connect to the server.

It seems that it still doesn't work well with Launchbox.

[skz]

I'm still stuck on "Querying Emumovies" when downloading images.

edit: still taking some time to query and slow scraping. Still got errors twice but went ok on the third run. Nevertheless, it did improve.

[Wanderer189]

Mine has improved greatly, lot less errors but still pretty slow scraping

[Circo]

3 hours ago, Wanderer189 said:

Mine has improved greatly, lot less errors but still pretty slow scraping

We were able to address the 0KB error and slow login yesterday.  We are working with LB on increasing search speed but it will require some code changes inside Launchbox itself as we implemented new API features.  This might take a bit to implement of course.  But all involved seem pretty excited about it.

[GamingZone]

I still seem to be having issues.  (Launchbox v12.9)

Attempting to update platform/playlist videos.  I currently have all LB Games DB platforms in my build + more I added manually (Total Platforms: 209).  I had 29 videos already for platform installed.  Upon calling the Launchbox Update Platform Videos Option it took approximately 21:47 Minutes. (Using Windows StopWatch) From my side it feels like Launchbox is making a request individually for each platform from EmuMovies and getting a delayed response, rather then a multi threaded response returning multiple items at once.

After Selecting my movie choices I attempted to update 107 videos....it downloaded 91 and I had 16 errors.  It took 12:55 minutes for this process.  (The errors were all 404's)

I have Fiber Internet (1Gb/s), No VPN on this PC, The internal network has a switch and router after the modem.)

Downloads from the website are slow, but at the same rate as they have always been for me. 

Downloads from the FTP still seem decent for speed.

[Evil]

11 minutes ago, GamingZone said:

I still seem to be having issues.  (Launchbox v12.9)

Attempting to update platform/playlist videos.  I currently have all LB Games DB platforms in my build + more I added manually (Total Platforms: 209).  I had 29 videos already for platform installed.  Upon calling the Launchbox Update Platform Videos Option it took approximately 21:47 Minutes. (Using Windows StopWatch) From my side it feels like Launchbox is making a request individually for each platform from EmuMovies and getting a delayed response, rather then a multi threaded response returning multiple items at once.

After Selecting my movie choices I attempted to update 107 videos....it downloaded 91 and I had 16 errors.  It took 12:55 minutes for this process.  (The errors were all 404's)

I have Fiber Internet (1Gb/s), No VPN on this PC, The internal network has a switch and router after the modem.)

Downloads from the website are slow, but at the same rate as they have always been for me. 

Downloads from the FTP still seem decent for speed.

Circo has explained in their previous message that they are still working on fixing the issue with Launchbox. Fixed issue with Emumovies Sync only for now.

We have to wait for Launchbox to update with the changes that Circo has commented on.

All the best.

[GamingZone]

5 minutes ago, Evil said:

Circo has explained in their previous message that they are still working on fixing the issue with Launchbox. Fixed issue with Emumovies Sync only for now.

We have to wait for Launchbox to update with the changes that Circo has commented on.

All the best.

I realize this information may be delayed to the fix, but I wanted to give an accurate view of what I was seeing as I knew they had a fix applied on 4/11.  I do Software QA for a living so I was attempting to narrow down some info.  I was mid test and documenting when Circo made his post above.  I felt it would be beneficial to share the info rather then not post at all.

Thanks.

[tailslide]

On 4/10/2022 at 3:50 PM, Circo said:

Any chance you are using a VPN?

 

No I am not using a VPN. I have pretty good internet too with gigabit download speeds and never have connection issues.
 

Just for fun I tried turning on VPN in case it was some CDN issue but still saw the same problem.

 

[HarryFlowers]

11 hours ago, Circo said:

We were able to address the 0KB error and slow login yesterday.  We are working with LB on increasing search speed but it will require some code changes inside Launchbox itself as we implemented new API features.  This might take a bit to implement of course.  But all involved seem pretty excited about it.

I've been one of those users experiencing slow scraping speeds when pulling through Launchbox. If I try to scrape a batch of titles I always get the timeout error. When I do them individually the query takes about 5-7 minutes. Once the query finishes I need to select the exact media item(s) I want to download immediately, otherwise it times out on me again. If I choose the items to pull and hit the download button quickly it pulls it at normal (fast) download speeds.

Sounds like you guys have a reasonable grasp on the issue at this stage so don't mean to pester, but if there's anything I could do to test as a user I'd be happy to help. I've tried multiple connection types through my VPN (P2P, Double VPN, etc...) but get the same result as without a VPN altogether. Wierd thing is... some days it scrapes OK (that is only for an individual title, not a batch), other days it takes 5+ minutes to scrape, but overall this issue has been ongoing since the last LaunchBox update as mentioned. Sratchin my head to think of other ways to troubleshoot, but open to try wtvr.

Thanks in advance for your guys hard work on this, love LaunchBox, love EmuMovies, hope this issue doesn't put up much more of a fight.

[Fearhad]

Any updates on the fix?

[Evil]

For Launchbox users do we have to wait for an update of Launchbox itself to fix the problem or is it not going to be necessary?

It seems that the problem with Emumovies Sync has been solved but the problem with Launchbox continues to this day.

Is a Launchbox update necessary?

Thank you.

[Circo]

Here is the latest update, seems most issues can be traced back to launchbox enabling multi threaded downloads on top of full library searches.  We did upgrades before release and they mostly worked.  One way in which our API's differ is that LB sends emumovies a full listing of all files and then the server matches everything and then generates a file list.  With Launchbox able to send a list of EVERYTHING YOU HAVE, that takes a lot of horsepower when its 100's of similar requests at a time.  The new search calls in the API will allow launchbox to do this crunching client side taking the strain off of the host server.  

The fixes we enabled resolved the 404 errors due to expired file links but even with login and search optimizations there is only so much we can do server side.  Currently our dev is preparing some sample code for launchbox to integrate. They are working closely together and this should bring performance to exactly the same level as Launchboxes built in database as they will both work about the same.

Been working on it the last week and once code is done, Launchbox will include the optimizations in a patch release most likely.

[Fearhad]

Thanks for the update!

[Wanderer189]

Not sure what happened last night, but things have started working again for me with Launchbox. Not sure if everything is working or if it is fixed, but it's a great start!

[Bitstorm]

Same here.  I'm guessing some other fix was applied to EmuMovies API in the last couple days.

There has been no update yet on LaunchBox code (still using 12.9), but for the last couple days querying EmuMovies from LaunchBox Edit Game -> Media -> Images takes about 5 seconds now.   Yay! 🙂

It's still a bit weird that it takes longer to search for available files for one specific game than to download them all (including videos) but it definitely feels like normal delays now.

[Wanderer189]

5 hours ago, Bitstorm said:

Same here.  I'm guessing some other fix was applied to EmuMovies API in the last couple days.

There has been no update yet on LaunchBox code (still using 12.9), but for the last couple days querying EmuMovies from LaunchBox Edit Game -> Media -> Images takes about 5 seconds now.   Yay! 🙂

It's still a bit weird that it takes longer to search for available files for one specific game than to download them all (including videos) but it definitely feels like normal delays now.

There has actually been 2 updates to Launchbox to work with new API/server put in place, v12.10.5 &v12.10.6 (enable beta in update settings)/ Most seem to be working good, however I see comments over there about Arcade (Mame) still having issues but can't verify

[Circo]

On 4/24/2022 at 11:45 AM, Wanderer189 said:

There has actually been 2 updates to Launchbox to work with new API/server put in place, v12.10.5 &v12.10.6 (enable beta in update settings)/ Most seem to be working good, however I see comments over there about Arcade (Mame) still having issues but can't verify

They solved it in the next beta, it was a mapping error.  Hopefully you are having a good result.

[Wanderer189]

48 minutes ago, Circo said:

They solved it in the next beta, it was a mapping error.  Hopefully you are having a good result.

So far, things are going well for me

[Variann]

it worked for me 2 times just updated launchbox which is now at version 12.11, then on emumovie it no longer finds any content when I give it a rom to check, I checked in the settings and the login on emumovie is correct please can someone help me?