Yet Another Cycling Forum

General Category => Audax => PBP => Topic started by: Diagonaliste on 24 August, 2019, 06:11:09 pm

Title: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diagonaliste on 24 August, 2019, 06:11:09 pm
Hi All,

I completed PBP on Thursday and was diligently managing the Garmin throughout, my current issue is that the file has uploaded to Garmin Connect but has not synced over to Strava, and will not upload from file to Strava either. Below is a list of all the options I have already tried without success in uploading to Strava. I have a ticket open with Strava, but not hearing any news on it thus far. If anyone has the skills to look into the .fit file and help me understand/fix whatever is preventing the upload, I would be hugely grateful for their attention. After such a hard ride, this is totally doing my head in. Please can anyone help me?

1. Garmin synced to Garmin Connect OK, and I can see the ride on Garmin absolutely fine.

2. Garmin Connect did not push out to Strava.

3. Followed troubleshooting for sync issues - de-linking the Garmin and Strava accounts, deleting the ride file from Garmin, and then re-linking the accounts and again syncing the ride file to Garmin Connect (in the hope that it would then push out to Strava - it didn't).

4. Got back to the UK and tried to upload to Strava from file. It attempts to analyse and match segments without the green bar ever going all the way to the right, then it indicates the status as 'Done' but the green bar will not go all the way to the right and the 'Save & View' button does not become active. I waited a long time for this to complete, but no change in status.

5. Exported the .fit file from Garmin Connect and tried to upload to Strava from file. Got a message in Strava saying that the file I am trying to upload is a duplicate of an uploading activity (2805565932).

6. I tried the fitfiletools time adjust to modify the start time to 1 minute before the original file (to differentiate from the original file that Strava indicates already exists). When I upload this file, the same as the original upload happens. It attempts to analyse and match segments without the green bar ever going all the way to the right, then it indicates the status as 'Done' but the green bar will not go all the way to the right and the 'Save & View' button does not become active.

7. Next I tried converting the .fit file to a .gpx file and uploading the .gpx file to Strava. I get the duplicated message again (duplicate of an already uploading activity (2805565932).

8. Wait to hear back from Strava.....

Well done to all who attempted PBP, and of course to those who completed too. This was my first and it was a real challenge.

I would really appreciate any help with the above, apologies for the long post.

Cheers,

Andrew.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Zed43 on 24 August, 2019, 06:22:43 pm
Followed the same steps (well, different strategy for step 6) with the same results. Have openend a ticket with Strava yesterday which resulted in a canned response and nothing useful. Since I actually pay for Strava I am not pleased with this.

I have seen people putting their complete (1220km) PBP ride on Strava, so it's not that the sheer size is a problem.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: zigzag on 24 August, 2019, 06:40:07 pm
i've got exactly the same issue and tried the same steps with the same results (i could have written the op word for word!). not sure how to proceed from where i am (i.e. stuck).
one thing i've noticed that the file in garmin connect cannot be exported as a tcx file for manual upload to strava (other rides can) - it displays a http 500 error. can it be a problem on garmin connect side?
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: andyp on 24 August, 2019, 06:48:18 pm
it may be that the rides you see on strava have been uploaded directly - that's how I got mine up there (I have never used Garmin connect).

A German friend of mine has the same problem and in an attempt to solve it, deleted the file from Garmin connect, but then found the Garmin site now won't allow him to reupload it saying the file already exists, so now he can't see it anywhere!?!
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: grapefruits on 24 August, 2019, 06:50:13 pm
same issue here but with a Wahoo. also tried modifying the start time to no avail. I started a ticket with Strava on Thursday but no response. even included the full file I want uploading. very, very annoying.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diagonaliste on 24 August, 2019, 07:02:29 pm
Quote from: zigzag on 24 August, 2019, 06:40:07 pm
i've got exactly the same issue and tried the same steps with the same results (i could have written the op word for word!). not sure how to proceed from where i am (i.e. stuck).
one thing i've noticed that the file in garmin connect cannot be exported as a tcx file for manual upload to strava (other rides can) - it displays a http 500 error. can it be a problem on garmin connect side?

Yes, I also had this.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diesel on 24 August, 2019, 08:48:20 pm
Wish I'd seen this earlier.... to cut a long story short as I'm in the same boat

- Wahoo won't upload/sync to Strava
- I downloaded the GPX fle and uploaded his manually to Strava
- It didn't sync
-Retry and get the "file I am trying to upload is a duplicate of an uploading activity" message

Now stuffed. It might sort itself and appear at some point, but given the number of occurences I doubt it

So its not a Garmin issue, has happened with Wahoo as well, so problem likely to lie with Strava

If anyone resloves - please update this thread! Good luck all
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Hofnar on 24 August, 2019, 09:40:13 pm
Same here.

Tried to ipload wedenesay early afternoon. Logged a support request same evening.
The will mail you a lot of useless instructions you will need to thick unhelpfull to get to next stage.

The will then after another two days send you the same rubissh instructions again.

Hello,

Quote
You're receiving this message because you have created multiple support requests. In order to simplify this process, we are merging your questions/feedback into one ticket. Your Premium Status has been included in this merge so your request will still be in line to receive a response and will be handled in the order it was received.

If you need to add any additional information to your request, please do so in the ticket number below.

Thanks for your patience!

Best,
The Strava Support Team
Quote


So basically you just get copy paste rubbish from them  :sick:  :sick:.

So they have just send computed reply's till now so I replied the following which I guess will be read somewhere in October by a non computer if lucky ;)

Quote
Dear,

Can you instead of sending me generic reply's who are only annoying and irritating me more just treat my query and solve it? Its now been over three days I have already found easily ten people having the same propblem. Starting to get vocal on the internet. What must we do to actually get treated correctly as a paying customer and not been just send generic copy paste answer? Must we get very vocal on facebook and twitter or can you just look into the issue correctly?

Kind regards

a probably soon to be former client who is getting close to recommend that to his friends to.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: craigofnz on 25 August, 2019, 05:31:42 am
I have the same issue. It we t from GC to RideWithGPS but not GC to Strava. Now same error regarding duplicate upload on manual upload and no response to my support ticket request. I am currently a Strava Summit member but may reconsider that when the renewal is due
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: yanto on 25 August, 2019, 06:10:32 am
I uploaded mine direct, I've always had problems with Connect.  I did have to stitch 6 files together first though which has caused problems in the past but thankfully not this time.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diagonaliste on 25 August, 2019, 07:32:03 am
What I don't understand is that the file must be OK, as for me it is displaying in Garmin Connect with no issues. I wonder why it is not working with Strava.... just so frustrating.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: jiberjaber on 25 August, 2019, 08:27:02 am
+1 here, ticket raised, bit frustrating!
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: CJ on 25 August, 2019, 08:58:40 am
I've got 3/4 of the ride that sync'ed automatically up on strava but the other half, which was saved correctly, did not sync.

I've got a ticket with strava but I'm not holding out much hope that it will be resolved so I've put the part of the ride up that I have.

Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Alex B on 25 August, 2019, 09:07:17 am
Quote from: jiberjaber on 25 August, 2019, 08:27:02 am
+1 here, ticket raised, bit frustrating!

Same here. I remember many of us has problems with the LEL uploads too.

It seems hard to work around. It's possible to convert the .fit file to a GPX using GPSBABEL (my thought was this could be simplified and uploaded) - but all the sensor data is lost, which I want to retain!

RWGPS imported the ride okay, so I tried to export a TCX history file with the thought of uploading this to Strava, since it retains sensor data. But this causes a timeout and RWGPS support have responded that this is because the file "is very large". No shit.

Obviously these services are more suited to weekend warriors than us serious cyclists  ;)
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: CJ on 25 August, 2019, 10:01:06 am

I tried the ridewithgps route too. No dice.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: kegere on 25 August, 2019, 10:11:51 am
I've fixed Strava upload, at the expense of lost cadence / HR in Strava. Not really an issue as this is available to me in RWGPS / GC (even though I used a Wahoo...).

Sorry I don't have time to write a full method however here is a summary:

1. Combine multiple FIT files and eventually get this into RWGPS (or maybe it was GC first - did this yesterday).

2. Export as GPX

3. Used https://simple-gpx.herokuapp.com with 2m resolution to reduce GPX to around 1.9MB (this stripped cadence/HR - will look at writing my own tool in the future or talking to Phil...)

4. Attempted Strava upload - again reported file already existed (ticket etc. raised yesterday)

5. Offset all timestamps by 1 hour. THIS SOLVED IT. I'm sure there must be an online tool to do this, I didn't have time to find one but this isn't too tricky in Python,

Here is my simple script for doing the conversion:

(click to show/hide)

Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Hofnar on 25 August, 2019, 10:14:25 am
 :demon: VICTORY  :demon:

I managed to find the reason and a relatively easy work around:

Looking for Strava's addres to bill them for my sunday morning overtime.

I would like to thank my russian friend Vladimir for borrowing me his STRAVA account to test the files without beiing blocked by the pending file on mine.

Its the sheer data size that gives the problem, i used Vladimirs account and the complete file jammed again on manual upload. Suspection a faulty bit I then cut the file in three slightly overlapping sections to find the faulty part but all three worked so the basic data seems fine.

Depending on your ride time and amount of sensors you will need two(I got away with two) or three files(I suggest cutting at a sleep or longer rest stop).

use the section remover from fit tools https://www.fitfiletools.com/#/remover to cut half or two thirds of the later part of the data away and save the file, You can already upload this one to Strava.

Do the same for the next section, do not immediately upload this file, it will have the same time stamp and be seen as a duplicate even whilst the route is completely different(Itried). You run it through fitfilestools again this time with the timestampadjuster tool https://www.fitfiletools.com/#/adjuster#view . Choose a new start time I suggest relatively close to the real times you started this part of the ride.

Good luck and let me know if it worked.

Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: grapefruits on 25 August, 2019, 10:14:57 am
RWGPS is showing something very odd with my files: my full PBP file which I combined using fitfiletools (https://ridewithgps.com/trips/39041788) is only showing data for the first 1101km - which is where I stopped my ride, but the map shows a track all the way back to the start.

If I upload separately, it shows https://ridewithgps.com/trips/39042179 and https://ridewithgps.com/trips/39042154

Weird.

Interestingly my Strava stats are showing my multiple PBP attempted uploads in my total distance for this year, but they're not appearing anywhere on my profile.It's also giving "--" for longest ride.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Hofnar on 25 August, 2019, 10:16:50 am
Quote from: kegere on 25 August, 2019, 10:11:51 am
I've fixed Strava upload, at the expense of lost cadence / HR in Strava. Not really an issue as this is available to me in RWGPS / GC (even though I used a Wahoo...).

Sorry I don't have time to write a full method however here is a summary:

1. Combine multiple FIT files and eventually get this into RWGPS (or maybe it was GC first - did this yesterday).

2. Export as GPX

3. Used https://simple-gpx.herokuapp.com with 2m resolution to reduce GPX to around 1.9MB (this stripped cadence/HR - will look at writing my own tool in the future or talking to Phil...)

4. Attempted Strava upload - again reported file already existed (ticket etc. raised yesterday)

5. Offset all timestamps by 1 hour. THIS SOLVED IT. I'm sure there must be an online tool to do this, I didn't have time to find one but this isn't too tricky in Python,

Here is my simple script for doing the conversion:


So we now have two options you guys can use  fittools for the timesstamp, no need to try an hour I got away with a few minutes just use your official group start time IMO
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: frankly frankie on 25 August, 2019, 10:50:47 am
Quote from: Hofnar on 25 August, 2019, 10:14:25 am
Its the sheer data size that gives the problem,

No!  Who knew.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: quixoticgeek on 25 August, 2019, 10:53:57 am


How big is the actual file you're uploading to strava?

Sounds like strava has a poorly thought through max file upload size. Probably from the same sort of thinking that causes a lot of garmins to not like longer rides. "But who would have a ride that long? Noone does a 1200km ride and upload it in one go..."

J
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Hofnar on 25 August, 2019, 11:04:23 am
Quote from: quixoticgeek on 25 August, 2019, 10:53:57 am


How big is the actual file you're uploading to strava?

Sounds like strava has a poorly thought through max file upload size. Probably from the same sort of thinking that causes a lot of garmins to not like longer rides. "But who would have a ride that long? Noone does a 1200km ride and upload it in one go..."

J
Quite some people rode it as one ride without sleep ;), I must admit I had one long beauty sleep after 700K.

The garmin file is 8MB and doesn't want to go through, My fittools created halves are 6.7MB each but sail through fine.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: stefan on 25 August, 2019, 11:11:59 am
Quote from: plasticniki on 25 August, 2019, 10:14:57 am
RWGPS is showing something very odd with my files: my full PBP file which I combined using fitfiletools (https://ridewithgps.com/trips/39041788) is only showing data for the first 1101km - which is where I stopped my ride, but the map shows a track all the way back to the start.

If I upload separately, it shows https://ridewithgps.com/trips/39042179 and https://ridewithgps.com/trips/39042154

Weird.

Interestingly my Strava stats are showing my multiple PBP attempted uploads in my total distance for this year, but they're not appearing anywhere on my profile.It's also giving "--" for longest ride.

"Refresh Stats" in my profile sorted out the issue about showing multiple attempted uploads in total distance and "-- " for longest ride after some failed upload attempts.

I've not tried re-uploading yet as I am getting a bit of help from a forumite considerably more technically expert than me in stitching together various bits of my track.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: quixoticgeek on 25 August, 2019, 11:13:11 am
Quote from: Hofnar on 25 August, 2019, 11:04:23 am
Quite some people rode it as one ride without sleep ;), I must admit I had one long beauty sleep after 700K.

The garmin file is 8MB and doesn't want to go through, My fittools created halves are 6.7MB each but sail through fine.

.fit files seem to be pretty damn efficient then. Just noticed the .fit file for last weekend's 300 is 1.8M, where as the GPX is 14M.

I wonder what arbitrary dice roll strava used to decide on the upload limit...

J
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: citoyen on 25 August, 2019, 11:18:23 am
Quote from: quixoticgeek on 25 August, 2019, 11:13:11 am
.fit files seem to be pretty damn efficient then. Just noticed the .fit file for last weekend's 300 is 1.8M, where as the GPX is 14M.

Surely there’s no need for the GPX file to be anything like that big, even for a 1200km ride? Is it not possible to run it through eg Phil W’s simplegpx tool to strip out extraneous data?
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Zed43 on 25 August, 2019, 11:20:35 am
The full .fit file is 11MB, still well under Strava's limit of 25MB. When I filter out the HRV data it comes down to 7MB, but still no go.

Just curious for those of you who also have problems:
* do you have a power meter
* do you have Di2 (or eTap)
(I'm a "yes" to both)

Extremely annoying, this. But what really vexes me is the lack of response from StravaSupport; why the heck do I pay for the full Summit package if they can't even respond in person to a problem (it's been two days now without response...)
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Hofnar on 25 August, 2019, 11:20:43 am
Quote from: quixoticgeek on 25 August, 2019, 11:13:11 am


.fit files seem to be pretty damn efficient then. Just noticed the .fit file for last weekend's 300 is 1.8M, where as the GPX is 14M.

I wonder what arbitrary dice roll strava used to decide on the upload limit...

J

They must be cos I set my data intervals quite narrow, got heart rate and power meter connected and uploaded as well.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: grapefruits on 25 August, 2019, 11:23:35 am
Quote from: Zed43 on 25 August, 2019, 11:20:35 am
* do you have a power meter
* do you have Di2 (or eTap)

nope. just heart rate data. the two fit files I am trying to combine and upload are 7.5mb and 700kb.

fitfiletools also seems to have broken on me now "Error: Java heap space"

 ???
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Zed43 on 25 August, 2019, 11:25:46 am
GPX files are uncompressed XML, that is always going to be big (it compresses well though).

@Hofnar with your workaround you get two (or three) separate rides in Strava I suppose? It doesn't get merged into one 1200km ride?
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: simonp on 25 August, 2019, 11:32:38 am
It's not that .fit is efficient, it's that gpx is an incredibility inefficient format. The extensions make it more so.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: quixoticgeek on 25 August, 2019, 11:36:39 am
Quote from: citoyen on 25 August, 2019, 11:18:23 am
Quote from: quixoticgeek on 25 August, 2019, 11:13:11 am
.fit files seem to be pretty damn efficient then. Just noticed the .fit file for last weekend's 300 is 1.8M, where as the GPX is 14M.

Surely there’s no need for the GPX file to be anything like that big, even for a 1200km ride? Is it not possible to run it through eg Phil W’s simplegpx tool to strip out extraneous data?

Oh god, this again.

Probably. I hit "download gpx" on strava, and looked at the size it produced. The gpx file exported from strava, is derived from the .fit file that went in from my wahoo. Thus as a comparison of efficiency of .fit vs .gpx, running it through anything would null the comparison.

Then there is the issue that disk space is cheap, I'm approaching the point where the amount of disk storage I have in the house is measured in petabytes. So a 14meg file is not worth my time and effort to make it smaller.

Does the GPX file need to be that big? probably not. Is it a problem that it's that big? not at all.

J
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: LittleWheelsandBig on 25 August, 2019, 11:48:09 am
Except when it is...
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: simonp on 25 August, 2019, 11:50:35 am
Often there's redundant whitespace in a .gpx which inflates the size. However the size of individual datapoints is at least several times, probably more, what they would be in a binary representation. The only advantage .gpx (and .tcx) has is it's human readable and thus possible to fix-up issues by hand.

Strava appears to be broken anyway - it can't process the large .fit file but it gets stuck in limbo so you are left in an unfixable mess. And their support is terrible.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: citoyen on 25 August, 2019, 12:01:34 pm
Quote from: LittleWheelsandBig on 25 August, 2019, 11:48:09 am
Except when it is...

Exactly.

Though it sounds like file size is not actually the problem here.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: zigzag on 25 August, 2019, 12:06:45 pm
fwiw, my .fit file that includes hr, cadence and power is 6.0mb for the whole pbp ride. (strava file size limit 25mb, so good for up to ~5000km. i've uploaded 4000km tcr ride without a problem before).

Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diagonaliste on 25 August, 2019, 12:35:25 pm
Solution gained.

I posted a message and request for help on the Garmin Forum and a very kind person of the name 'OnlyTwo' had a look and re-sized the file for me (10Mb down to 1.3Mb) and it has uploaded to Strava with no issues. I have no idea what 'OnlyTwo' did, but I am very grateful to them.

Sorry that so many of us seem to be having similar issues.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: kegere on 25 August, 2019, 01:06:39 pm
Strava uses AWS, at a guess imports are handled by a lambda instance or similar. My guess is if processing does not complete by a timeout the process hangs in this middle ground.

This would explain my fix if making file much smaller and offsetting time to make it a 'new' ride.

although the is a file size limit
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: veloboy on 25 August, 2019, 01:19:01 pm
Since Garmin Connect does not support my 'dumb' etrex-30, I have just joined the tracks together (all three of them for PBP) and uploaded them to starve as GPX files without any issues. This does require a USB cabled connection to a computer to do this; thankfully a mate had his laptop at the finish and we did this over a beer  :thumbsup: :thumbsup:
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: simonp on 25 August, 2019, 01:56:41 pm
etrex 30 will not record so much data, and might record fewer samples - a much smaller gpx will result.

My Summit membership is up for renewal next month, I noticed.

They can't handle the file - ok. They leave it in limbo so you have to jump through hoops to try to sort it out - nok.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Kim on 25 August, 2019, 03:24:12 pm
Quote from: quixoticgeek on 25 August, 2019, 11:13:11 am
I wonder what arbitrary dice roll strava used to decide on the upload limit...

PHP default memory limit? :)


Strava's rejection of duplicates is a royal pain in the arse.  Particularly if you want to upload a file and crop different parts out of it (those of us with sensible Garmins end up with two rides in the same file when we forget to press the right button at the start of a ride, rather than no data).
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Hofnar on 25 August, 2019, 03:32:59 pm
Quote from: Zed43 on 25 August, 2019, 11:25:46 am
GPX files are uncompressed XML, that is always going to be big (it compresses well though).

@Hofnar with your workaround you get two (or three) separate rides in Strava I suppose? It doesn't get merged into one 1200km ride?

Two or three separate rides sadly.
My main interesst is Power data, flyby and some interesting segements so its not that bad for me. Would be nice to get on ride but there for you need to compress data and that's past my skills.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diagonaliste on 25 August, 2019, 04:03:54 pm
Quote from: Diagonaliste on 25 August, 2019, 12:35:25 pm
Solution gained.

I posted a message and request for help on the Garmin Forum and a very kind person of the name 'OnlyTwo' had a look and re-sized the file for me (10Mb down to 1.3Mb) and it has uploaded to Strava with no issues. I have no idea what 'OnlyTwo' did, but I am very grateful to them.

Sorry that so many of us seem to be having similar issues.

I asked what 'OnlyTwo' did and they responded with the following;

How did you fix it?
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: jiberjaber on 25 August, 2019, 06:55:33 pm
I have that so will try when I get home tonight
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Zed43 on 25 August, 2019, 09:26:36 pm
I've managed to upload my ride as well. Wrote a program to condense the data (roughly the same as what OnlyTwo did: throw out the HRV data and accumulate HR/speed/distance/power/cadence/temperature but nothing else for 3 seconds into one).

Without any optimisation the (single threaded) program runs in 10 seconds on a MacBook, boggles the mind why Strava doesn't do such a cleanup for large files before further processing.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: jiberjaber on 26 August, 2019, 12:45:29 am
Finally uploaded, I too used fit file repair tool and appended my files whilst downsampling to 5 second and removing power & R-R data.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Zed43 on 26 August, 2019, 08:42:04 am
I must be dense this morning, but what is R-R data?
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Feanor on 26 August, 2019, 08:57:05 am
Mine manually uploaded to Strava just fine, it took just a few seconds.
I didn't pass it up via Garmin Connect like I usually do, I wanted to remove as many potential points of failure as I could.

I spliced 4 x 300k files together using the Fit File Repair Tool, did not downsample in any way.
The files only had position / time data; I wasn't recording HR or Power.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diagonaliste on 26 August, 2019, 09:07:15 am
Quote from: Zed43 on 26 August, 2019, 08:42:04 am
I must be dense this morning, but what is R-R data?

I wasn't sure either, but googling it shows this from the Polar website; RR recording saves RR intervals, i.e. time between successive heartbeats, for further analysis. Heart rate varies with every heartbeat. Heart rate variability (HRV) is the variation of RR intervals.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: zigzag on 26 August, 2019, 11:40:51 am
i've tried the online fit file repair tools, however they did not fix the file in a way that could be uploaded to strava. still have a strava ticket open, but no response from them (except the default automated one). luckily i can see all the metrics in ridewithgps, which is helpful, but i'd still want the file on strava as that is where i log all my riding that matters.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Zed43 on 26 August, 2019, 12:41:26 pm
If you have trouble uploading, pm me and I'll give you my email so I can try to condense your file with my program (it's rather user-unfriendly at the moment).
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Phil W on 26 August, 2019, 04:17:32 pm
Sorted out Diesel's PBP GPX for him.

I used my own web utility https://simple-gpx.herokuapp.com/ set at 1m accuracy, and retain timestamps and elevation boxes ticked.

Then from the GPX returned I shifted all the timestamps by 1 minute.  This latter part I did on my PC as I don't have an online utility written to do that. I found through experimentation that shifting the times by 1 minute was the minimum for Strava not to reject the ride as duplicate.

Diesel has now reported that he was able to upload the resulting PBP GPX to Strava.

My web utility does not retain power, HR, cadence or other data as that is not its intended purpose.  But if you are just interested in the raw position, timing, and elevation data then it is a route for others.  I believe there are tools to shift the timestamps somewhere online.

Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Phil W on 26 August, 2019, 05:09:27 pm
Ok, I've added the ability to add or subtract one minute from all the timestamps in a GPX track.

https://simple-gpx.herokuapp.com/

In one hit, you will be able to use my web utility to get around Strava duplicate rejection, and simplify the data to the point it doesn't time out. Again if you want to retain power, cadence, HR, electronic shift data data look elsewhere.

Use 1 metre accuracy, retain timestamps and elevation boxes ticked. Choose timestamp shift amount from new dropdown.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diesel on 26 August, 2019, 08:49:42 pm
Big thanks to Phil for doing this
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: zigzag on 26 August, 2019, 09:25:11 pm
Quote from: Zed43 on 26 August, 2019, 12:41:26 pm
If you have trouble uploading, pm me and I'll give you my email so I can try to condense your file with my program (it's rather user-unfriendly at the moment).

Zed43 has worked his magic and now my file is uploaded to strava, including power/cad/hr/temp data, and correct start time.

one bug in strava is that for every failed upload attempt it still added to my total mileage, so it shows that i rode almost 5000km more this year than i actually have. i am awaiting for strava's response (the non automated type).
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diesel on 26 August, 2019, 09:57:03 pm
zigzag - I had the same issue. Under My Stats on Strava there is a button to Refresh Stats - this solved it for me
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: zigzag on 26 August, 2019, 10:23:13 pm
Quote from: Diesel on 26 August, 2019, 09:57:03 pm
zigzag - I had the same issue. Under My Stats on Strava there is a button to Refresh Stats - this solved it for me

nice one - refreshing stats solved it for me too - thanks!
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diagonaliste on 27 August, 2019, 06:20:01 am
Quote from: zigzag on 26 August, 2019, 10:23:13 pm
Quote from: Diesel on 26 August, 2019, 09:57:03 pm
zigzag - I had the same issue. Under My Stats on Strava there is a button to Refresh Stats - this solved it for me

nice one - refreshing stats solved it for me too - thanks!

Sorted for me too. Thanks.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: FifeingEejit on 27 August, 2019, 11:46:03 am
Quote from: quixoticgeek on 25 August, 2019, 11:13:11 am
Quote from: Hofnar on 25 August, 2019, 11:04:23 am
Quite some people rode it as one ride without sleep ;), I must admit I had one long beauty sleep after 700K.

The garmin file is 8MB and doesn't want to go through, My fittools created halves are 6.7MB each but sail through fine.

.fit files seem to be pretty damn efficient then. Just noticed the .fit file for last weekend's 300 is 1.8M, where as the GPX is 14M.

I wonder what arbitrary dice roll strava used to decide on the upload limit...

J

I had this problem with strava after a 1000, it's not the file size per se it's their systems ability to process all the data within the file.

If you watch the upload process box carefully enough it gets past the upload of the FIT file pretty easily, but then throws a wobbly when it starts doing Stravaey stuff like looking for segments and working out your "suffer score" from HR (or whatever it's called these days) etc.

Probably why eTrex users in the past haven't had much of a problem uploading it is because all that's in there for them is a load of co-ordinates.

RidewithGPS does less of the wanky piss stuff with the data that's been collected, leaving you to analyse it yourself if your browser can cope with being fed that much...
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: zigzag on 27 August, 2019, 12:07:37 pm
what i'm puzzled about is why it managed to upload a much longer ride before (with the extra sensor data as well), but got stuck this time. unless they changed/reduced their timeout limits recently.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: citoyen on 27 August, 2019, 12:40:16 pm
Quote from: zigzag on 27 August, 2019, 12:07:37 pm
what i'm puzzled about is why it managed to upload a much longer ride before (with the extra sensor data as well), but got stuck this time. unless they changed/reduced their timeout limits recently.

Or maybe they're doing even more of the wanky piss stuff!

Which, tbh, seems quite likely with the way Strava is being run these days.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: iroiromono on 27 August, 2019, 12:44:11 pm
Quote from: phil w on 26 August, 2019, 05:09:27 pm
Ok, I've added the ability to add or subtract one minute from all the timestamps in a GPX track.

https://simple-gpx.herokuapp.com/

In one hit, you will be able to use my web utility to get around Strava duplicate rejection, and simplify the data to the point it doesn't time out. Again if you want to retain power, cadence, HR, electronic shift data data look elsewhere.

Use 1 metre accuracy, retain timestamps and elevation boxes ticked. Choose timestamp shift amount from new dropdown.

Similar issues here with the single ride file:

I've taken the .fit file from my elemnt and this uploaded to rwgps from where I extracted a gpx file.

 Trying this in Phil's tool resulted in an applocation error from the applet. :(
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Phil W on 27 August, 2019, 04:55:26 pm
282,000 trackpoints in your GPX.  Just a question of running out of allocated CPU and time to process it.  simple-gpx runs on a free platform as a service, so it is what it is. A trackpoint every 4 metres is somewhat excessive :-)
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: iroiromono on 27 August, 2019, 05:18:14 pm
Quote from: phil w on 27 August, 2019, 04:55:26 pm
A trackpoint every 4 metres is somewhat excessive :-)

I totally agree. I wish the wahoo had a way of reducing the number of samples from 1/sec to something slower.


I found a solution to load the gpx file to mygpsfiles.com and then using their facility to change the number of points and make the slight time adjustment to keep strava happy.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: simonp on 27 August, 2019, 05:22:19 pm
1/sec is pretty standard for recording power etc. Pretty sure TrainerRoad advise against anything else as it messes up analytics.

Currently paying for TrainingPeaks TrainerRoad and Strava. Strava is the only one that has messed up badly. Renewal is next month. Good chance to save a few quid.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: FifeingEejit on 27 August, 2019, 06:59:01 pm
The more I look at what I use strava premium for... Which is basically the Heatmaps and the fitness/freshness graph which I'm sure I can figure out to a similar extent by just going for a walk up a hill at lunch time (I do it most days and seems to be a good indicator of how knackered I am).

The more I think I'll gain from switching to RWGPS premium.

Thought I seem to have just overloaded RWGPS' ability to join rides
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: simonp on 30 August, 2019, 02:34:12 pm
Quote from: simonp on 27 August, 2019, 05:22:19 pm
1/sec is pretty standard for recording power etc. Pretty sure TrainerRoad advise against anything else as it messes up analytics.

Currently paying for TrainingPeaks TrainerRoad and Strava. Strava is the only one that has messed up badly. Renewal is next month. Good chance to save a few quid.

Strava have now responded to my support request and say they will try a manual upload of the file themselves - if this works then I will be pleased.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Zed43 on 30 August, 2019, 08:28:52 pm
PM me if it doesn't, so far my program to condense from 1/s to 1/3s worked for all .fit files that came directly from a GPS (Strava did not accept the one that came from ridewithgps).
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: simonp on 30 August, 2019, 09:11:19 pm
Quote from: Zed43 on 30 August, 2019, 08:28:52 pm
PM me if it doesn't, so far my program to condense from 1/s to 1/3s worked for all .fit files that came directly from a GPS (Strava did not accept the one that came from ridewithgps).

Thanks - waiting to hear back from them. So far it hasn't appeared. My .fit is merged from a selection of files as I reset the Garmin part-way.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Kamoshika on 03 September, 2019, 10:45:57 am
Bit late to the party on this one, but just to say I had similar problems. I recorded the ride in three parts on my Wahoo. I exported the rides from the Wahoo app as .fit files by syncing them to Dropbox. From there I uploaded the files to fitfiletools and combined them into a single activity. They offer an "upload to Strava" option, which didn't work, so I downloaded the complete .fit file and tried uploading to Strava manually. That looked like it had worked but tripped over on the analysing segments stage, refused to go any further, and told me the activity already existed when I tried again. Next step was to try converting the file to .gpx (I don't ride with a power meter or HRM, and not bothered about temp data) but I couldn't find an online converter that would handle a file that big. So, converted the three individual .fit files to .gpx separately and combined them. Annoyingly that gave me a 25.3MB file which is just over the Strava file upload limit. Downloaded a text editor app that can handle regular expressions, and stripped the last decimal place out of each of the co-ordinates, reducing from 7 to 6 d.p. (excuse to post a link to the XKCD cartoon: https://xkcd.com/2170/  ;D) which brought the file inside the limit and allowed me to upload it. I too had a support call open with Strava which they responded to after about a week to say "we see you've already fixed this yourself"  ::-)

Thanks for the tip on resetting the Strava stats - mine too were showing too many km for the year, and that fixed it.
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: Diagonaliste on 24 September, 2019, 06:40:34 am
Almost 1 month after I raised the Strava support ticket, in the past few days a human has been responding to the ticket with some news.

After I explained in the ticket that I had the file size reduced by someone on the Garmin Forum and it uploaded fine, the support person was wondering if I wanted to ever upload the original. I said no, but enquired if Strava were going to roll out a fix for uploads that stall (with a file under the Strava limit of 25Mb). Seems that they have, although I haven't tried to upload a 10Mb file yet. See response from Strava below;

The issue has been fixed. But those stalled uploads will never reupload without us manually trying to reupload them. Or you could reupload with the file itself if you wanted to. Any new upload of that size should be processed without a problem.

Lets hope it works!
Title: Re: PBP Garmin File Upload Issue - Can anyone help?
Post by: simonp on 24 September, 2019, 08:01:46 am
They manually uploaded mine. However, segment matching is not done - this is the part of the process that triggered the stall, apparently.

I'm tempted to now delete the original and replace it with a simplified version.