Yet Another Cycling Forum

General Category => Audax => Topic started by: DanialW on 19 August, 2009, 12:56:25 pm

Title: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 12:56:25 pm
I'm taking a proposal to the next commitee meeting, to allow me to test using tracklogs and GPX files to check and validate DIY perms on my patch. I hope that the commitee will allow me a temporary waiver to validate rides without the normal proof of passage, such as stamps and receipts.

If the committee are amenable, how do you see such a system developing?

My first thought is that the shortest distance between controls needn't apply, as the route ridden will be clear to see. How to might I be reasonably confident that the rider rode the route? I don't think there will be issues with forged tracklogs, but how might I guard against such nefarious deeds?

Any thoughts gratefully welcome. Any volunteers to experiment on also happily considered.
Title: Re: Using tracklogs to validate DIY perms
Post by: Fietser on 19 August, 2009, 01:47:16 pm
I think you would still need some 'traditional' proofs of passage. I can't imagine why someone would want to commit audax-fraud, but it is fairly straightforward to take an existing gps track and just change the dates on the track points.

But with a gps track it should be possible to require less receipts etc, and distance verification will be much easier, and result in less disputes

Title: Re: Using tracklogs to validate DIY perms
Post by: tom_e on 19 August, 2009, 01:47:53 pm
My first thought is that the shortest distance between controls needn't apply, as the route ridden will be clear to see. How to might I be reasonably confident that the rider rode the route? I don't think there will be issues with forged tracklogs, but how might I guard against such nefarious deeds?

As a computery guy rather than someone who knows about Audax:  It'd be pretty trivial for anyone competent to forge a single gpx file. 

I know there's no reason for tough security, but maybe asking just a couple of receipts for the whole ride (which match up with the tracklog) might be cautious?  Just a single something/anything more than the tracklog alone. 

Then it's surely worth the fairer distance/easier planning benefits.

Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 01:50:21 pm
It's a good point you two make. I did wonder if there was potential to use, say MS Excel to check two ostensibly identical tracklogs to make sure they were sufficiently different in terms of geolocation, gaps bewtween points, etc.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 01:52:04 pm
My first thought is that the shortest distance between controls needn't apply, as the route ridden will be clear to see. How to might I be reasonably confident that the rider rode the route? I don't think there will be issues with forged tracklogs, but how might I guard against such nefarious deeds?

As a computery guy rather than someone who knows about Audax:  It'd be pretty trivial for anyone competent to forge a single gpx file. 

I know there's no reason for tough security, but maybe asking just a couple of receipts for the whole ride (which match up with the tracklog) might be cautious?  Just a single something/anything more than the tracklog alone. 

Then it's surely worth the fairer distance/easier planning benefits.


I can't imagine it would be much effort to completely fabricate a gpx in much less time it takes to go out and gather receipts using some other means than human muscular effort.
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 19 August, 2009, 01:58:10 pm
Excellent Danial. Good luck with the proposal.

I suggested this on the AUK list a few years ago and was met with a whole list of ways in which GPS-related proof of passage could be forged. Of course it could. But so could more conventional means. The whole system is built on trust anyway. For example, use of Info controls on perms, manual annotation of receipts where the till time is wrong or has no indication of the location, using postmarks on postcards, the fact I can get Fixed Wheel Points for a perm that no-one else witnesses etc. etc.

Long may we continue to rely on trust, and lets not put new methods of route identification under greater scrutiny than older ones.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 19 August, 2009, 01:59:32 pm
I've also had problems with the GPS turning itself off, either due to rattling or old batteries of duff rechargeables. I don't always notice either, especially if I'm going over familiar roads where I don't need the GPS for direction.

Saying that, it would certainly make it easier to ride DIYs along nicer routes. There are times when I've had to miss out on certain roads/routes purely because of a lack of an appropriate control on one section. Being able to rely on the GPX for proof of passage for some subsections (not even all of the ride) would be very useful.

It would also make convoluted routes much easier. For example, I'd like to be able to do the Surrey Hills route as a detour from home to work (or vice versa) as a DIY 100. It's possible to DIY it, but it means compromising the route.

http://www.bikely.com/maps/bike-path/167493

The problem is the lack of anything useful in Ewhurst. There's a pub but I'd be looking to do this early in the morning when it won't be open. I can DIY it by moving the control to Cranleigh but that pulls me off the route that I want to take.

Being able to use normal controls (Putney, Epsom, Dorking, Epsom, Putney or Waterloo) with the GPX file for Ewhurst would solve this problem.
Title: Re: Using tracklogs to validate DIY perms
Post by: saturn on 19 August, 2009, 02:00:10 pm
I'd have thought that it's better evidence than the current method. At present, someone could drive between the controls and hang around long enough at each to make it convincing - you'd never know they weren't on a bike. Presumably the GPS log would reveal average speeds attained at various points? If so a cheat would have to be very careful to drive in such a way as to mimic a bike - so much so it would probably be more trouble than it's worth. Actually, I'm struggling to think of a way of cheating that's less detectable using a GPS than with the current system.

Freedom from having to faff about finding proof of passage at particular locations would certainly encourage me to have a go at DIY's.

Edit just read the above posts about forging the GPX file entirely, never thought about that. Wouldn't it be a pain to make it look convincingly cycle like?
Title: Re: Using tracklogs to validate DIY perms
Post by: tom_e on 19 August, 2009, 02:01:37 pm
It's a good point you two make. I did wonder if there was potential to use, say MS Excel to check two ostensibly identical tracklogs to make sure they were sufficiently different in terms of geolocation, gaps bewtween points, etc.

I wouldn't personally bother - down this road lies a technical tit-for-tat improvement in checking and falsifying gpx files.  Ask for something real-world instead to make it less appealing to the inner geek to try it.

I can't imagine it would be much effort to completely fabricate a gpx in much less time it takes to go out and gather receipts using some other means than human muscular effort.

For the first one, yes, but once the script is written... 

I'm just suggesting requesting a single something else to be cautious really.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 02:02:34 pm
I presume you'll still need an entry form with minimum distances calculated using Autoroute or ViaMichelin ? What if the tracklog is shorter than the approved entry ? I presume it'll be ignored and only the time of passage considered ?
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 19 August, 2009, 02:03:30 pm
If the 'shortest route' concept is ditched, will you still have controls?

Will riders still submit their route in advance? How closely will you check that the route they ride is the same that they submitted?

If they go off route, do they have to return to their first deviation? Or just ride far enough to make up the distance? What about road closures?
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 02:04:39 pm
If the 'shortest route' concept is ditched, will you still have controls?

Will riders still submit their route in advance? How closely will you check that the route they ride is the same that they submitted?

If they go off route, do they have to return to their first deviation? Or just ride far enough to make up the distance? What about road closures?

CUrrently we just submit a list of controls and distances with the entry form, no route. This can't change surely ?
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 02:05:05 pm
Being able to use normal controls (Putney, Epsom, Dorking, Epsom, Putney or Waterloo) with the GPX file for Ewhurst would solve this problem.

What an excellent suggestion. I'd never thought of this.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 02:07:12 pm
If the 'shortest route' concept is ditched, will you still have controls?

Theoretically, no. The route is the route. The downside would be a lack of freedom to improvise as you go along, which a control-based system affords you.

Personally, I favour a control-based system, but I'm willing to have my head turned.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 19 August, 2009, 02:07:17 pm
Actually, I'm struggling to think of a way of cheating that's less detectable using a GPS than with the current system.

I could create a realistic fake GPX tracklog without having to get off my chair, let alone drive around a route in a car collecting receipts.

All I'd need to do is take a tracklog of a route created on bikehike and apply some semi-realistic error to it (I know what kind of error to add as I've compared many tracklogs to actual GPX logs). Then I'd write something to fake the timestamps based on a bunch of variable parameters. With a bit more work I could also create a program that could take the tracklog and create any number of gpx tracklogs for realistic "rides", I can add my own simulation of wind, tiredness, random delays for punctures/stops, etc to make each one different.

Mind you, it's still quite a lot of work when I'd rather be out riding the bike.

I'm with jwo. It's highly unlikely that someone would go to all that effort to fake it, so why bother worrying about it. And if they do then more fool them.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 02:08:56 pm
If the 'shortest route' concept is ditched, will you still have controls?

Theoretically, no. The route is the route. The downside would be a lack of freedom to improvise as you go along, which a control-based system affords you.

Personally, I favour a control-based system, but I'm willing to have my head turned.

so the entry form would simply say "on Monday 28th I'm going to ride 207km " ?
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 19 August, 2009, 02:10:12 pm
I wouldn't want a gpx file to be anything other than the plain text file it is, but it is rather unfortunate that there is no embedding of the GPS Id in the file, similar to the way the camera info is embedded in a Jpeg.

I think forging a convincing track from scratch might be quite challenging (even if it seems simple to some people here) - however copying and re-dating an existing (ridden by someone else) track is very easy.  So I think you need a hardcopy proof of passage at the furthest point of the ride, at least.  But with that in hand, I don't see so much problem with the rest of it.

Your point about the shortest distance thing would be a real plus, and I feel sure might help sell it to committee who otherwise might be expected to let their inner luddites out for a run, on a proposal like this.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 02:10:19 pm
I'm with jwo. It's highly unlikely that someone would go to all that effort to fake it, so why bother worrying about it. And if they do then more fool them.

FranklyFrankie made the point that wireless GPS units may be able to send tracks to each other in the future, which may make the vlidation of gpx files during events a bit trickier.

But for now, I'm going to pilot this, committee permitting on DIY/Mesh routes. And indeed, more fool you if you're prepared to forge one.
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 19 August, 2009, 02:10:58 pm
As a computery guy rather than someone who knows about Audax[...]

Let's not get carried away with speculating about how such things could be forged. As both a computery guy and someone who does Audax, the main point to me is that I have absolutely no desire or reason to forge a DIY route. There is no point. My inner geek has no trouble in seeing that such a thing could be forged, but that doesn't mean anyone would actually do so.

As for Matt's point about controls, you could still keep the same rules about controls (max distance between them, nominal min and max times to arrive at them etc.). It's just that proof that you get to those controls at a given time would be via the tracklog, not a receipt. Nothing to stop you going off route, following road diversions etc. just like we do at the moment, as long as you do arrive at the pre-agreed controls within time.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 02:11:55 pm
so the entry form would simply say "on Monday 28th I'm going to ride 207km " ?

Not quite. It might say "I'm going to rie 207km, and here is the route as a gpx that I made on memory map/bikely/wherever.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 02:13:11 pm
As for Matt's point about controls, you could still keep the same rules about controls (max distance between them, nominal min and max times to arrive at them etc.). It's just that proof that you get to those controls at a given time would be via the tracklog, not a receipt. Nothing to stop you going off route, following road diversions etc. just like we do at the moment, as long as you do arrive at the pre-agreed controls within time.
But that doesn't tally with what Danial just said. No pre agreed controls, just a route. I am warming to the idea of not having to ride roughly 10% more to satisfy the agreed route. All I need now is someone to make a GPS that is tiny and will record my path without having to sit on my handle bars and get in the way. Don't need it to tell me where to go.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 02:14:53 pm
As for Matt's point about controls, you could still keep the same rules about controls (max distance between them, nominal min and max times to arrive at them etc.). It's just that proof that you get to those controls at a given time would be via the tracklog, not a receipt. Nothing to stop you going off route, following road diversions etc. just like we do at the moment, as long as you do arrive at the pre-agreed controls within time.
But that doesn't tally with what Danial just said.

I see this as a thrasharound of ideas. I've no fixed proposal yet, as nothing's been tested or really thought through thoroughly.
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 19 August, 2009, 02:17:01 pm
As for Matt's point about controls, you could still keep the same rules about controls (max distance between them, nominal min and max times to arrive at them etc.). It's just that proof that you get to those controls at a given time would be via the tracklog, not a receipt. Nothing to stop you going off route, following road diversions etc. just like we do at the moment, as long as you do arrive at the pre-agreed controls within time.
But that doesn't tally with what Danial just said.

True - that's rapid cross-posting for you.

My personal opinion is that getting points for 200km of tracklog, do be decided on the day is not quite in the spirit of Audax. I think part of the challenge is have a pre-defined route that you are obliged to follow, overcoming weather and other difficulties to complete it.

The Mile-eater Award (note, based completely on trust) is the one for people who just want to get credit for the kms.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 02:19:42 pm
I think there has to be a pre-defined route, be it defined by controls or a fixed route.

I'll wager there are insurance implications in ensuring that as a minimum.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 19 August, 2009, 02:21:22 pm
FranklyFrankie made the point that wireless GPS units may be able to send tracks to each other in the future, which may make the vlidation of gpx files during events a bit trickier.

Spotting identical gpx tracklogs is trivial. It's no different to the fact that receipts from petrol stations/ATMs can be photocopied and submitted by another rider. If looked for it would be obvious that they were duplicates.

Even two identical GPS devices, similarly configured, running side by side on the handlebars of the same bike will produce quite different tracklogs. It would even be pretty much impossible for anyone to determine whether two such GPX files were the result of one rider with two GPSes, or two riders on separate bikes who just happened to ride close to each other for the entire ride.
Title: Re: Using tracklogs to validate DIY perms
Post by: PaulF on 19 August, 2009, 02:23:19 pm
Quote
From Mseries
 All I need now is someone to make a GPS that is tiny and will record my path without having to sit on my handle bars and get in the way. Don't need it to tell me where to go

There's a number of applications for the iPhone and Blackberry that will do that. I assume there's something similar for other GPS equipped phones
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 19 August, 2009, 02:23:47 pm
Something else worth thinking about, is that different GPSes will produce GPX data formatted differently.

This could also be something as relatively trivial as different sampling rates.  My Satmap Active 10 produces tracks at either 1 sample / second or 1 sample / 4 seconds.  This means that the logs that it produces are typically thousands or tens of thousands of points, and several megabytes in size.  Some tools, like Bikely, will refuse to import a file this big, so I have to use GPSBabel to simplify the route.  This of course means that it's no longer a pristine GPX file from the GPS, but has been manipulated.

Other formatting issues could make some tools refuse to entertain importing data from certain GPSes.

You may need to require GPX data to be in a certain format, and are likely to need (i) tools or mechanisms to convert into this form, and (ii) tools to validate whether the data is in an acceptable form.
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 19 August, 2009, 02:24:01 pm
... I have absolutely no desire or reason to forge a DIY route. There is no point. My inner geek has no trouble in seeing that such a thing could be forged, but that doesn't mean anyone would actually do so.

Sure - but as a regulatory body, AUK are obliged to concern themselves with these kind of possibilities.  No-one's pretending its a watertight ship - its just a question of keeping the rules of the game such that everyone continues to enjoy playing it.

[edit] blimey its hard to get a post in edgeways here
Title: Re: Using tracklogs to validate DIY perms
Post by: Deano on 19 August, 2009, 02:26:04 pm
Could you use it to validate climbing and AAA points?
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 02:26:11 pm
Quote
From Mseries
 All I need now is someone to make a GPS that is tiny and will record my path without having to sit on my handle bars and get in the way. Don't need it to tell me where to go

There's a number of applications for the iPhone and Blackberry that will do that. I assume there's something similar for other GPS equipped phones

really ? Is there one for the DTC Touch Pro ? and a big FO battery pack to keep it running for long enough ?
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 19 August, 2009, 02:27:51 pm
All I need now is someone to make a GPS that is tiny and will record my path without having to sit on my handle bars and get in the way.

My eTrex works quite well in my rackpack (as long as it is relatively near the top). I'm sure it would work quite well ziptied to the outside of a small seatpack on a 200km day ride.

Reliability is a bit of a gamble though. If it turns off for any reason (being knocked, vibration, duff batteries) you may do quite a bit of your ride without noticing or being logged...)
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 19 August, 2009, 02:30:10 pm
Tracklogs for PoP? Gets my vote.

How long before we start to see retro audaxes? Fixed gear, no gps allowed - printed routesheet only, no computerised PoPs. There could be an award - in a retro 1930s styling.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 02:31:54 pm
Tracklogs for PoP? Gets my vote.

How long before we start to see retro audaxes? Fixed gear, no gps allowed - printed routesheet only, no computerised PoPs. There could be an award - in a retro 1930s styling.
:thumbsup:
Title: Re: Using tracklogs to validate DIY perms
Post by: philip on 19 August, 2009, 02:33:26 pm
All I need now is someone to make a GPS that is tiny and will record my path without having to sit on my handle bars and get in the way. Don't need it to tell me where to go.
Tiny GPS data loggers exist: I-GotU (http://www.easydevices.co.uk/pp/GPS_Receivers/GPS_Tracker/I-GotU_USB_GPS_TRAVEL_DATA_LOGGER.html). I've not used one so I can't say how well it works.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 02:34:25 pm
without agreed controls then I suppose one would have to stick to the proposed route.
Title: Re: Using tracklogs to validate DIY perms
Post by: Paul D on 19 August, 2009, 02:34:30 pm
An example:

Danial's Mesh route - Frome to Amesbury. The shortest route is the A303. :sick:

The alternative is one of the nicest places to cycle in the country - the Wylye Valley. Unfortuanely this is about 10k longer, just for this section, so my Mesh routes end up at about 230k, although 'officially' I only ride about 205k.

Would validation via gpx file mean that a pre-authorised 'Frome - Amesbury via the Wylye Valley' be possible?
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 19 August, 2009, 02:38:19 pm
Sure - but as a regulatory body, AUK are obliged to concern themselves with these kind of possibilities.[...]

Yes I agree - but let's be consistent with the degree of scrutiny that is applied. I think that every Audax I've been on with info controls has had at least someone asking the controller at the end what the answer was (and long may that continue). FWC, Mileeater and some other rolls of honour are based on trust without any validation.

As has been pointed out upthread, there are real benefits to long distance cycling by allowing for tracklogs as proof of passage, that are within the spirit of Audax. I hope a proposal put forward by Danial is considered seriously, and not scuppered by techno-fear or distractions about hypothetical cheaters.
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 19 August, 2009, 02:39:12 pm
How long before we start to see retro audaxes?

Already happening in the US.
(time penalties for using battery lights)
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 19 August, 2009, 02:40:34 pm
Tiny GPS data loggers exist: I-GotU (http://www.easydevices.co.uk/pp/GPS_Receivers/GPS_Tracker/I-GotU_USB_GPS_TRAVEL_DATA_LOGGER.html). I've not used one so I can't say how well it works.

I use one quite often, as a backup to record where I've been when I'm on rides where someone else is leading, and I would like to have a record of where I've been for later reference.

The IgotU has a significantly poorer accuracy than a decent handlebar mounted GPS, largely because it has a much smaller and possibly badly orientated antenna.  It's probably perfectly adequate for this sort of purpose however.

Also, to get a decent runtime, you have to reduce the time between track points, but one point every 20 or 30 seconds will allow the battery to last 20+ hours, which is probably OK.

One of the downsides with it, is that it is hard to know if it's working reliably, I managed to have it configured wrong for the Bath Blast the other day, and it didn't record anything, but unlike a "conventional" GPS with a big display, the only difference between on and off is a blue LED which flashes every 15 seconds or so.

Having said all that, this sort of GPS is probably OK for this purpose, with the caveat that as with anything technological, things can go wrong in an non-obvious way (ie you delete the track instead of downloading it etc)
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 19 August, 2009, 02:41:41 pm
Would validation via gpx file mean that a pre-authorised 'Frome - Amesbury via the Wylye Valley' be possible?

I don't see why you need to specify the exact route. If you can specify one or two extra controls in the Wylye Valley using GPX as proof of passage, i.e.

Controls:

Frome: Receipt/ATM
Village_1: GPX
Village_2: GPX
Amesbury: Friar MTuck Cafe receipt
...

The distance is then the shortest route between the controls named (including villages where suitable controls don't exist) which should give a figure much closer to the real ride distance.

You just do the ride as normal, collecting the other receipts along the way. The DIY Organiser then looks at the GPX file to make sure you went through the other places as you said you would.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 02:45:37 pm
If these changes are permitted I think it is important that every DIY organiser is part of it. Or permit all such entries to be submitted to Danial to allow all riders to use it.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 03:26:43 pm
Of course, one could operate both a control-based system and an actual route system.

However another factor to consider is organiser time. The current DIY regs are designed to avoid organisers getting tied in checking and debating routes. If a system doesn't allow me to check a route and bang out an email in 2-3 minutes, I'm not going to use it.
Title: Re: Using tracklogs to validate DIY perms
Post by: L Hedley on 19 August, 2009, 03:31:19 pm
At the end of the day, the only person they end up cheating is themselves!  But, maybe I could steal some of my hubbies track logs and submit them, they do lack personal info so can't really be checked, but then so do receipts etc, even a cashwithdrawal one can't really prove it was him or me!   Mind, I don't think anyone would actually beleive it if I submitted one for a ride longer than 100kms :P
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 19 August, 2009, 04:16:05 pm
If a system doesn't allow me to check a route and bang out an email in 2-3 minutes, I'm not going to use it.

I think that's a good point. It would be quite easy for us to use or write a simple bit of free software that given a GPX file would display its total distance, time taken etc. If that software was made available to everyone, riders could check it themselves before sending to to validators for er... validation. In theory it should be quicker than checking the times and locations of a set of soggy receipts.
Title: Re: Using tracklogs to validate DIY perms
Post by: Rich753 on 19 August, 2009, 04:18:52 pm
Would this eliminate the need for physical brevet cards, enabling me to submit everthing electronically?

Sounds like a win to me!
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 04:20:06 pm
Would this eliminate the need for physical brevet cards, enabling me to submit everthing electronically?

Sounds like a win to me!
I presume one would still need to send off an entry form.
Title: Re: Using tracklogs to validate DIY perms
Post by: Rich753 on 19 August, 2009, 04:21:38 pm
Why not submit entry form by email?

Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 04:28:10 pm
Why not submit entry form by email?


I'd love to. DOn't really know the answer to your question. I'm just another punter.
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 19 August, 2009, 04:30:14 pm
I submit my DIY entry forms electronically as a PDF with a scanned copy of my signature.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 19 August, 2009, 04:33:05 pm
I submit my DIY entry forms electronically as a PDF with a scanned copy of my signature.
I knew they'd be differences amongst the different DIY organisers. Hence my earlier comment.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 04:34:04 pm
Yeah, I take these as well.
Title: Re: Using tracklogs to validate DIY perms
Post by: Rich753 on 19 August, 2009, 04:34:53 pm
Why not submit entry form by email?


I'd love to. DOn't really know the answer to your question. I'm just another punter.

Me too!

Just struck me that this mechanism has a bunch of benefits - reduces chances of stuff getting lost in the post, could get a "proof of receipt" from the organiser for a submission, means you can still submit even if you've run out of envelopes or stamps (is that just me?), and I wondered just how electronic it could be?

So question for Danial - is this part of your thinking in your proposal to AUK committee?
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 19 August, 2009, 04:43:21 pm
I scanned in my signature, used Alt+PrtScr to screen grab it, cut and trimmed it in MS Paint, saved it as an image and inserted it in the right place into a Word Document version of the AUK Entry form (typed in to Word by myself) with the usual details (my name, auk number, address, etc) filled in. This is saved as my template.

When I want to enter a DIY ride I use this template file, add in the missing details (date, distance, controls, etc), save it as a new file and then email it to Andy U.

I've often done this at the last minute without getting the OK that the route is the required distance although this is risky and it'd be my fault for not getting it checked out first if it turned out to be under-distance. Haven't had a problem as most of my DIY rides are reasonably over distance anyway.

Reminds me, need to send one off to Andy with the DIY+Calendar ride for this weekend.

All of this is a small part of the whole approval/validation process though. A DIY Brevet Card still has to go to the Validator(s), recorder(s), back to the DIY organiser and then back to the rider.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 04:48:50 pm
Just struck me that this mechanism has a bunch of benefits - reduces chances of stuff getting lost in the post, could get a "proof of receipt" from the organiser for a submission, means you can still submit even if you've run out of envelopes or stamps (is that just me?), and I wondered just how electronic it could be?

So question for Danial - is this part of your thinking in your proposal to AUK committee?

No, because it happens already. I'm always happy to take an entry form by email. Indeed, if you pay by Paypal for an AUK event, you won't fill out a standard application form.
Title: Re: Using tracklogs to validate DIY perms
Post by: Rich753 on 19 August, 2009, 04:56:03 pm
Just struck me that this mechanism has a bunch of benefits - reduces chances of stuff getting lost in the post, could get a "proof of receipt" from the organiser for a submission, means you can still submit even if you've run out of envelopes or stamps (is that just me?), and I wondered just how electronic it could be?

So question for Danial - is this part of your thinking in your proposal to AUK committee?

No, because it happens already. I'm always happy to take an entry form by email. Indeed, if you pay by Paypal for an AUK event, you won't fill out a standard application form.

<trying to keep up>

so how does/can the rider get his brevet card without submitting an sae?  Apologies if this is old hat to you all, feel free to simply point me to a relevant info point !
Title: Re: Using tracklogs to validate DIY perms
Post by: Manotea on 19 August, 2009, 05:06:32 pm
so how does/can the rider get his brevet card without submitting an sae?  Apologies if this is old hat to you all, feel free to simply point me to a relevant info point !

Buy a job lot of DIY Brevet cards in advance. If nothing else you'll save on postage. I've forgotten how much they are but its something like 5 for £10. Then, assuming you have a validated route - or at least a route you are reasonably certain is AUK legal - all you have to do is email the org a prefilled appform as detailed by GB above with details of the controls appended to the bottom anytime before you actually setoff. Probably best to request deliver and read ack as proof of transmission. Leastways, thats what I do....
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 19 August, 2009, 05:11:23 pm
No, because it happens already. I'm always happy to take an entry form by email. Indeed, if you pay by Paypal for an AUK event, you won't fill out a standard application form.

<trying to keep up>

so how does/can the rider get his brevet card without submitting an sae?  Apologies if this is old hat to you all, feel free to simply point me to a relevant info point !
Much discussion here, just FYI:
DIY advice needed (http://yacf.co.uk/forum/index.php?topic=1008.0)
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 19 August, 2009, 05:20:29 pm
Sorry, should have said, I buy the cards in bulk and have a stash lying around.

I've forgotten how much they are but its something like 5 for £10.

£2 each or 6 for £10, so you'll save £2 buying in bulk (although you generally need to put a 'Large' stamp on the SAE if you're buying 6).

That being said, I usually rely on shop/ATM receipts as proof of passage, not stamps in the card, so I usually leave the Brevet Card at home.

I've only ever once used a stamp/signature (luckily I had the card with me) and that's because I was right on the time limit and the B&B owner said she'd sign the card which saved me a few minutes wander down the road to a cashpoint that may not have been working.
Title: Re: Using tracklogs to validate DIY perms
Post by: JJ on 19 August, 2009, 06:20:50 pm
I LOVE  :-* the controls-based approach.  It'll open up so many beautiful rides without fundamentally changing what an Audax is, so I'd say let's get that working before trying to open up the route-based approach.

As to falsifying, IF anyone cares, I think it would be a good deal more trouble to make a file up with realistically varying speeds along the way, than to fake up receipts.  if someone goes round the whole route at exactly 22.5kph, then I think we might smell a rodent.

Danial, you're my hero. ;D
Title: Re: Using tracklogs to validate DIY perms
Post by: Panoramix on 19 August, 2009, 06:25:03 pm
If a system doesn't allow me to check a route and bang out an email in 2-3 minutes, I'm not going to use it.

I think that's a good point. It would be quite easy for us to use or write a simple bit of free software that given a GPX file would display its total distance, time taken etc. If that software was made available to everyone, riders could check it themselves before sending to to validators for er... validation. In theory it should be quicker than checking the times and locations of a set of soggy receipts.

Funnily enough, I have started a few months ago to write a script that goes through my gpx file and says:

I haven't talked too much about it as it is not quite finished. I am not a professional programmer and it takes me time but I don't mind giving it away as a starting point.

I have sussed out how to get rid of dubious elevations, finding stops does not work so well!


... or may be jwo can write this in a couple of hours!
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 19 August, 2009, 06:30:41 pm
As to falsifying, IF anyone cares, I think it would be a good deal more trouble to make a file up with realistically varying speeds along the way, than to fake up receipts.  if someone goes round the whole route at exactly 22.5kph, then I think we might smell a rodent.
The issue is that once someone works out how to do it, it will be automated, and the floodgates may open.

Someone will take pride in 'hacking the system', even if they give not a sod about SRs, championships etc. The classic "spoiling it for everyone".

(Of course if we can use it to increase the UK quota for PBP '11 ... :) )

With the "old-fashioned" methods it will always be quite a bit of boring work to fake it.
Title: Re: Using tracklogs to validate DIY perms
Post by: marcus on 19 August, 2009, 06:36:02 pm
Good luck with this Danial!

I think this is definitely the way forward & as others have said we shouldn't get too hung about the possibility of cheating.

Ian H accepted a tracklog from me to validate one of his perms last year. This wasn't agreed with him in advance - it was because I was stupid enough to leave a zip undone on my saddlebag while I was riding & lost most of my control receipts. However I did still have start & finish receipts which tallied with the tracklog.
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 19 August, 2009, 07:17:01 pm
Someone will take pride in 'hacking the system', even if they give not a sod about SRs, championships etc. The classic "spoiling it for everyone"

On what basis do you think it more likely that people will hack a false GPX file than, say, write a program to print out realistic looking cashpoint receipts? Why this sudden fear about cheating?
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 19 August, 2009, 07:28:35 pm
Someone will take pride in 'hacking the system', even if they give not a sod about SRs, championships etc. The classic "spoiling it for everyone"

On what basis do you think it more likely that people will hack a false GPX file than, say, write a program to print out realistic looking cashpoint receipts? Why this sudden fear about cheating?

I should emphasise that I don't think this is going to happen! I was just making the point that e-cheating is a different ball-game to old-fashioned cheating. There could be an avalanche, whereas with 'normal' perms there may well be a few cheats out there as we write, but they will remain in the minority, and noone really cares.

If you techno-whizkids with your new-fangled toys take over the perm scene and win all the awards going, I shan't be gnashing my teeth thinking "They's cheating, ain't they!"

I just think it's  an issue worth considering in setting this up. (Just as cheating has always been considered in the creation of current rules. In fact, why else would we have validation other than by the rider?)

M

(BTW: I reckon producing fake receipts would be harder and/or easier to spot than fake GPX files, but it's just a hunch.)
Title: Re: Using tracklogs to validate DIY perms
Post by: JJ on 19 August, 2009, 07:56:53 pm
Well, maybe you're right and maybe I am, but Oh the prospect of a DIY with controls at places where you would have put infos into a calendar event, and even maybe couldn't have found one, and not having to worry about whether there's a cashpoint by Trumpton fire station.  I'm off to design a 200 that goes round all the best tea rooms in Suffolk and doesn't go near the Haverhill road. What about riding from Looe to Penzance without having to go through Truro?

I can hardly contain myself. :-[
Title: Re: Using tracklogs to validate DIY perms
Post by: Phixie on 19 August, 2009, 08:19:12 pm
Excellent Danial. Good luck with the proposal.

 The whole system is built on trust anyway. For example, use of Info controls on perms, manual annotation of receipts where the till time is wrong or has no indication of the location, using postmarks on postcards, the fact I can get Fixed Wheel Points for a perm that no-one else witnesses etc. etc.

Long may we continue to rely on trust, and lets not put new methods of route identification under greater scrutiny than older ones.


Just out of interest, how many times at the end of a Calendar ride when you produce your FWC card has the finish controller wanted to check your machine?  Same as the number of fingers on a clenched fist, I'll wager.
Title: Re: Using tracklogs to validate DIY perms
Post by: border-rider on 19 August, 2009, 09:02:07 pm
It happened to me once in 7 years and a lot of km.
Title: Re: Using tracklogs to validate DIY perms
Post by: Manotea on 19 August, 2009, 09:34:13 pm
I'm not convinced you know. Yes tracklogs support continuous riding with no stopping at controls but I like controls. The fact that every few hours you need to take moment or several to get a control and take a break is a good thing. Its what makes audax what it is, and is a large part of teh difference between audax and racing, if you like.

What are the upsides? They remove the problem of seeking out controls but in practice how often is this a problem? Why not simply allow riders to submit timestamped photos as proof of evidence? Digital phots can be submitted electronically just as easily as tracklogs and it could be said depending on teh required subject matter would be harder to fake.

What are the downsides? Well, for a start, tracklogs are rarely clean. One of my jobs when I complete a ride is to strip out all the doubling backs and off routings that inevitably occur, and lace together umpteen tracksegments which make up the route (tracklogs get segmented when you recalc a route or switch a unit off as I do at controls to save power), filter down the tracklog to an approproiate samplying rate and so on. Its not credible this would be done by those who would submit tracklogs to any common standard. Even with clever scripts I cannot see processing tracks saving much time for org or rider.

Personally I'd like to see a DIY routes published in some way so that routes can be seen made up of control segments (A_B xkm, B_C, ykm, etc.). This information sharing would provide riders with information and inspiration on valid routes, and provide a handy lookup table for inter control distances for use by riders and orgs alike. This is similar but a different purpose/requirement to the system for documenting route segments which FF initiated.

Well, those are my thoughts....

PS, do I ride DIYs? yes I do. do I sometimes find myself well over distance because of the difficulty getting controls? yes I do. do I spend a chunk a time researching potential controls for rides? yes I do. Its all part of the fun...
Title: Re: Using tracklogs to validate DIY perms
Post by: toontra on 19 August, 2009, 09:48:04 pm
PS, do I ride DIYs? yes I do. do I sometimes find myself well over distance because of the difficulty getting controls? yes I do. do I spend a chunk a time researching potential controls for rides? yes I do. Its all part of the fun...

The tracklog verification wouldn't be compulsory - you could still have your fun if you choose.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 19 August, 2009, 09:56:18 pm
PS, do I ride DIYs? yes I do. do I sometimes find myself well over distance because of the difficulty getting controls? yes I do. do I spend a chunk a time researching potential controls for rides? yes I do. Its all part of the fun...

You know, it's the "now I don't have to ride 30km overdistance" that I find weakest.

I'm with you on this Manotea; it's all part of the fun. I like cycling "over" distance. It's another hour out on  my bike.
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 19 August, 2009, 10:24:23 pm
But it's not very "self sufficient" though is it, to rely on others to stamp our cards or provide receipts for us?

One of the big advantages of allowing GPS (or timestamped photos for that matter) would be to allow us to ride some of the calendar or perm routes without the need to resort perm organisers constructing info controls, or replacing infos with diversions to settlements that have cashpoints etc.

I have a favourite DIY perm that I can do from home that takes me through rural Essex. Except I can't currently do it on a Sunday because it relies upon a post office that closes for the weekend on Saturday afternoon. I have another 200 that I have to do in less than 10 hours with a 6am start because the garage at the end of the ride closes at 4pm. A more flexible attitude to proof-of-passage would open up new opportunities for DIY Audaxes currently denied us.
Title: Re: Using tracklogs to validate DIY perms
Post by: Manotea on 20 August, 2009, 04:20:28 am
But it's not very "self sufficient" though is it, to rely on others to stamp our cards or provide receipts for us?
Sounds like an arguement against organised controls....

One of the big advantages of allowing GPS (or timestamped photos for that matter) would be to allow us to ride some of the calendar or perm routes without the need to resort perm organisers constructing info controls, or replacing infos with diversions to settlements that have cashpoints etc.
As you say, allowing timestamped photos would solve the problem.

I have a favourite DIY perm that I can do from home that takes me through rural Essex. Except I can't currently do it on a Sunday because it relies upon a post office that closes for the weekend on Saturday afternoon. I have another 200 that I have to do in less than 10 hours with a 6am start because the garage at the end of the ride closes at 4pm. A more flexible attitude to proof-of-passage would open up new opportunities for DIY Audaxes currently denied us.
It cannot be denied. Except does it matter? Does every outing have to be accounted for in AUK ledgers? I passed the rubicon this year when I rode round the little willy and nyctophobic (calendar 100km routes) 'just for fun', though I suspect I'll find a way to claim for extracurricular circuits of 200km+ routes like Anfractuous and Willy Warmer.

'Just Sayin'*

*homage to editon of The Daily Show I watched last night...
Title: Re: Using tracklogs to validate DIY perms
Post by: tonyh on 20 August, 2009, 07:30:24 am
A good discussion, and very interesting even to this rider who will probably remain without a Magic Box. Thanks to Danial for his welcome suggestion/offer.

I think this point is worth another repeat:

another factor to consider is organiser time. The current DIY regs are designed to avoid organisers getting tied in checking and debating routes. If a system doesn't allow me to check a route and bang out an email in 2-3 minutes, I'm not going to use it.

... and I would hate you to find yourself using it!

I like cycling "over" distance

So do I, but it can put me close to time limits. Which can be fun; but it is often a great relief to know that there's a good route for the next leg which is NOT over-distance. Hence the interest in anything which makes such routes more available.
Title: Re: Using tracklogs to validate DIY perms
Post by: Hot Flatus on 20 August, 2009, 08:09:58 am
I think this is a great idea and one that has ocurred to me one every audax I have done with a gps on the bike where I've forgotten to look out for info controls. I'd always assumed that the luddite lobby within the audax community would keep it suppressed.

I think the cheating aspect is not important for all the reasons others have given .  If you think it is, you probably need to stop doing audaxes  ;)
Title: Re: Using tracklogs to validate DIY perms
Post by: Ian H on 20 August, 2009, 08:22:06 am
But it's not very "self sufficient" though is it, to rely on others to stamp our cards or provide receipts for us?

Self-sufficiency includes using facilities available on the route rather than having stuff ferried around ahead of you. As well as coping if the shop is shut.
Title: Re: Using tracklogs to validate DIY perms
Post by: phil d on 20 August, 2009, 08:30:44 am
I also like the idea of a control based GPX verification on permanents.  I'm not so keen on a route-based process - this seems a major departure though perhaps that's just me being Luddite.  But Mr Tea's comment strikes a chord
I'm not convinced you know. Yes tracklogs support continuous riding with no stopping at controls but I like controls. The fact that every few hours you need to take moment or several to get a control and take a break is a good thing. Its what makes audax what it is, and is a large part of teh difference between audax and racing, if you like.
I would not want to see calendar events change, for all the reasons Paul gives (to say nothing of forcing calendar organisers, some of whom are still delightfully operating in the late 19th C, to use computer-based mapping).  But once the genie is out of the bottle will it be possible to limit the scope?
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 20 August, 2009, 08:31:52 am
But it's not very "self sufficient" though is it, to rely on others to stamp our cards or provide receipts for us?
... or launch a few satellites to save us the trouble ...      ;)
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 20 August, 2009, 08:34:57 am
But it's not very "self sufficient" though is it, to rely on others to stamp our cards or provide receipts for us?
... or launch a few satellites to save us the trouble ...      ;)
LOL.

I quite like the idea of GPX proof of passage for some controls. If I used a GPS device I'd probably take advantage of this option if I could, that is if my local organiser provided it. 
Title: Re: Using tracklogs to validate DIY perms
Post by: toontra on 20 August, 2009, 08:36:49 am
... (to say nothing of forcing calendar organisers, some of whom are still delightfully operating in the late 19th C, to use computer-based mapping).

Surely there is no compulsion in any of this.  Organisers would be free to accept gpx files or not (stating so in the entry form) and riders would be free to carry on as present.  I don't see the problem here.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 20 August, 2009, 08:39:46 am
There MUST be no compulsion for organisers nor riders.
Title: Re: Using tracklogs to validate DIY perms
Post by: MattH on 20 August, 2009, 08:54:30 am
I'm not convinced you know. Yes tracklogs support continuous riding with no stopping at controls but I like controls. The fact that every few hours you need to take moment or several to get a control and take a break is a good thing. Its what makes audax what it is, and is a large part of teh difference between audax and racing, if you like.


I don't think that's the point. I love eating a full english breakfast in a cafe several times a day too, but I could be aiming to do that in two towns 10km apart by doing a lovely scenic 50km loop over Welsh hills that doesn't have a convenient control point in it. A tracklog would let me do that.

I like tracklogs, but they also aren't perfect. Several times I've had to fix corrupt files to allow them to load into analysis/mapping tools; it needs a certain level of tech-awareness to be able to do that - and a willingness to accept that a long ride might not be validated because your GPS played up and trashed the data.

I think this is an excellent suggestion, I hope it gets the nod and without many extra security/validation add-ons. Start out by trusting people, and if there is a problem with cheating then deal with it as it comes up. If we don't trust our own, then we should ban DIYs altogether and insist that everyone on a normal audax is escorted by a scrutineer.
Title: Re: Using tracklogs to validate DIY perms
Post by: Philip Whiteman on 20 August, 2009, 09:27:09 am
Damn it.  I will have to go out and buy a GPS now!

On the whole, Danial's idea is excellent :thumbsup:. I may even ride some DIYs next year and link them into Mesh nodes - GPS will make life a lot easier!

I just hope that the committee keep it simple without adding lots of additional rules making the process complex.

Title: Re: Using tracklogs to validate DIY perms
Post by: mtrike on 20 August, 2009, 10:42:59 am
A couple of points having ridden a 200 perm yesterday just using the garmin.  Firstly it threw a fit when I ignored a (wrong)route instruction and had to be rebooted.  Hence the track log has a 5 mile or so gap whilst it sorted itself out.  Easily overcome though with some thought to the rules of engagement allowing for such circumstances given that I must still have got from the end of one part of the ride to the beginning of the next.  Secondly had the mood taken me I could easily have driven round the route with the aircon on collecting receipts from the various shops so the whole thing of collecting proof of passage is bollocks anyway.
Title: Re: Using tracklogs to validate DIY perms
Post by: Hot Flatus on 20 August, 2009, 11:09:31 am
I could easily have driven round the route with the aircon on collecting receipts from the various shops so the whole thing of collecting proof of passage is bollocks anyway.

A quick bit of dodgy maths suggests that to cheat via car in order to have beaten last years championship winner would have cost over £1500 in fuel and running costs whereas cheating via GPS hacking would only require the neccessary skills.

That said, a cheater would still have to be seen riding 50% of those rides on Calender events, which means 11,400 km.... hardly run of the mill stuff and someone motivated enough to ride that doesn't fit the profile of a lazy cheat.

It strikes me that the only cheating that matters is cheating other people out of a prize, but as I've said, this seems unlikely.
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 20 August, 2009, 11:24:46 am
I'll be a guinea pig!

Danial, say I wanted to ride this route that I've just invented and put on Bikely:

Bicycle Path - Tintern Abbey 200 at Bikely.com (http://www.bikely.com/maps/bike-path/Tintern-Abbey-200)

Can I email you an entry form, pay by paypal, attach the .gpx of the proposed route for your approval and then go and ride it?  Afterwards I'll mail the actual gpx of what I did.  No brevet card required, as far as I can see.

I won't be after official validation, but you could use it as an example to put to the committee perhaps?

Next thursday if anyone's interested in joining me!  :)





Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 20 August, 2009, 12:36:53 pm
I'll be a guinea pig!

Danial, say I wanted to ride this route that I've just invented and put on Bikely:

Bicycle Path - Tintern Abbey 200 at Bikely.com (http://www.bikely.com/maps/bike-path/Tintern-Abbey-200)

Can I email you an entry form, pay by paypal, attach the .gpx of the proposed route for your approval and then go and ride it?  Afterwards I'll mail the actual gpx of what I did.  No brevet card required, as far as I can see.

I won't be after official validation, but you could use it as an example to put to the committee perhaps?

Next thursday if anyone's interested in joining me!  :)

It's a bit quick, tbh. I've only just started work on this. :-(
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 20 August, 2009, 01:19:24 pm
No problem, just shout when you're ready for some test mules!
Title: Re: Using tracklogs to validate DIY perms
Post by: Philip Whiteman on 20 August, 2009, 01:25:27 pm
I'll be a guinea pig!

Danial, say I wanted to ride this route that I've just invented and put on Bikely:

Bicycle Path - Tintern Abbey 200 at Bikely.com (http://www.bikely.com/maps/bike-path/Tintern-Abbey-200)

Can I email you an entry form, pay by paypal, attach the .gpx of the proposed route for your approval and then go and ride it?  Afterwards I'll mail the actual gpx of what I did.  No brevet card required, as far as I can see.

I won't be after official validation, but you could use it as an example to put to the committee perhaps?

Next thursday if anyone's interested in joining me!  :)


I rode this Cambrian Series route a week ago today.  And guess what, I thought, "what is the point of collecting receipts when I could simply provide proof via GPS".  Inspiration!

By the way, you will enjoy the route.  
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 20 August, 2009, 01:28:58 pm
Thanks Rob!

At this stage, I just wanted to float the idea to see what ideas and thoughts people had. This thread has been really useful in confirming a few ideas I had, raising a few issues, and suggesting problems and ideas I'd not thought of.

I'm not going to propose any specific plan to the committee, just that we be allowed to experiment with a few ideas to see what works.

Hopefully, we can start in early October.
Title: Re: Using tracklogs to validate DIY perms
Post by: arabella on 20 August, 2009, 01:31:58 pm
There's also the case of 2 friends, one with Tracking thingy and one without.  Can the person without be validated on the strength of the friend's tracking thingy and friend signing brevet card on the way round either the whole time or just when no control is available (for example).

Is this any different from another person saying I controlled at X (their house) or Y (receipt illegible) etc.

I suspect at the moment it's up to the validator's discretion - does this ned re-examining?
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 20 August, 2009, 01:32:27 pm

I rode this Cambrian Series route a week ago today.  And guess what, I thought, "what is the point of collecting receipts when I could simply provide proof via GPS".  Inspiration!

By the way, you will enjoy the route.  

Thanks.   :)

I've ridden CS2B a few times via Chepstow but it's always been a PITA getting proof of passage.  A tailor-made version starting at home seems a much more civilised way of riding a perm.
Title: Re: Using tracklogs to validate DIY perms
Post by: Euan Uzami on 20 August, 2009, 01:39:35 pm
I'm taking a proposal to the next commitee meeting, to allow me to test using tracklogs and GPX files to check and validate DIY perms on my patch. I hope that the commitee will allow me a temporary waiver to validate rides without the normal proof of passage, such as stamps and receipts.

If the committee are amenable, how do you see such a system developing?

My first thought is that the shortest distance between controls needn't apply, as the route ridden will be clear to see. How to might I be reasonably confident that the rider rode the route? I don't think there will be issues with forged tracklogs, but how might I guard against such nefarious deeds?

Any thoughts gratefully welcome. Any volunteers to experiment on also happily considered.
Not sure if it's already been mentioned but look for some evidence of speed variation, such as when going down/up hill, and due to wind. If someone cheats by driving, then these tell tale signs of a typical cycle ride may not be present.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 20 August, 2009, 01:42:54 pm
Not sure if it's already been mentioned but look for some evidence of speed variation, such as when going down/up hill, and due to wind. If someone cheats by driving, then these tell tale signs of a typical cycle ride may not be present.

It's considerably easier to fake a realistic looking tracklog than it is to reliably detect whether such a tracklog is genuine or not.
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 20 August, 2009, 01:48:12 pm
Not sure if it's already been mentioned but look for some evidence of speed variation, such as when going down/up hill, and due to wind. If someone cheats by driving, then these tell tale signs of a typical cycle ride may not be present.

If nothing else the velocity will be wrong, so anyone who drove with a GPS, would have to modify the file anyway to make their speed (or timings) look correct.  If I was doing that, I'd use the altitude variations to correct the speed, so I was slower going up hill anyway (and with additional noise, random stops etc).

The only way you can really detect a fabricated or modified GPS file, would be to look at statistical variations in position, altitude and velocity information (where these are provided in the GPX of the track).  The distribution of the values is likely to follow some particular form, and something outside of this would look suspicious (with a certain probability of not being valid).

If you wanted to check for this sort of thing, you would probably have to write something that could do a statistical analysis of the data, but you would have to keep it "secret", since anyone who saw what analysis was done, could trivially write code that could be guaranteed to generate data to pass this test.

As others have said, it's probably too much work to bother trying to defeat someone who feels the need to cheat at this sort of thing, you would just have to let the odd loon with too much time on their hands get through the system.
Title: Re: Using tracklogs to validate DIY perms
Post by: Euan Uzami on 20 August, 2009, 02:01:54 pm
oh granted. my suggestion, while it would detect some fairly craply-done instances of cheating, would let other more clever ones slip through the net. it would be a fairly uncomplicated algorithm to weed out people who haven't bothered to put much effort into cheating, but it would probably be more labourious to write than it would be worth.


One other point, completely aside from cheating, is this: could it not give rise to *any* ride on which you had your GPS on, being able to be converted into an Audax? e.g. i did a 200 mile ride over the weekend, could I not *retrospectively* say that that was  DIY audax?
If the answer to that is "all DIY audaxes have to be pre-planned", then what is the reason WHY they should have to be preplanned?

Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 20 August, 2009, 02:07:12 pm
If the answer to that is "all DIY audaxes have to be pre-planned", then what is the reason WHY they should have to be preplanned?

Simply put, the Spirit of Audax is completing what you have set out to do.

If you want to submit unvalidated rides of any distance then keep a MileEater log book/diary.
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 20 August, 2009, 02:36:05 pm
One other point, completely aside from cheating, is this: could it not give rise to *any* ride on which you had your GPS on, being able to be converted into an Audax? e.g. i did a 200 mile ride over the weekend, could I not *retrospectively* say that that was  DIY audax?

An interesting point is how would you check that the ride has followed the planned route?  If you submitted your route as a GPX, I guess you could write a script to compare the original route and the generated track, and allowing for a generous error in the GPS, list any point where the route wasn't followed, or the track when too far off the route.  I guess then it would be up to the DIY organiser to decide on how much variation between the two was acceptable.

(Although a route with just a few points, and then a track with a lot more points would be interesting to compare, you would probably have to interpolate points and compare to that, or compare the track points to a line between route points...)

There would also be a complication if a set of controls was planned for the route, but then a GPX was submitted as the proof, or even the opposite way around, although it would certainly be possible to write suitable scripts to check a list of controls against a GPX file in both these scenarios, it's just potentially a bit more effort required to set things up.
Title: Re: Using tracklogs to validate DIY perms
Post by: MattH on 20 August, 2009, 02:49:11 pm
The obvious thing is to load it into some mapping software and check it goes through the right places. Sites like Garmin connect can do this and show the stats for the ride (time, average speed). If a particular site or tool (e.g. mapsource) was being used then it should be stated so that riders can check their file works OK.
Actually, this is the kind of thing that could potentially be put together onto the AUK website - a simple tool that riders and organisers can access, using something like the google maps API to show mapping, and give the details an organiser needs without relying on a third party website.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 20 August, 2009, 02:56:31 pm
An interesting point is how would you check that the ride has followed the planned route?

Any program that can import more than one GPX file will do this. A visual check doesn't take more than a minute or so at a reasonable level of zoom.

Here are a couple of examples importing GPX files into GPS Trackmaker (Free version).

LEL whole route (mine in red, overlayed on top of simonp's in blue): http://www.greenbank.org/misc/lel1.jpg
Zoomed in on the area covering Thurlby (bottom) up to Thorne (top): http://www.greenbank.org/misc/lel2.jpg

Note my preference for the more direct A15 after Thurlby. Not sure what the detour is on the Wragby->Thorne dogleg, can't remember going off route (but then it was a long ride :)

The straight line North of Thorne is where my GPS batteries ran out and therefore there's a 10 mile section missing.

 If you submitted your route as a GPX, I guess you could write a script to compare the original route and the generated track, and allowing for a generous error in the GPS, list any point where the route wasn't followed, or the track when too far off the route.  I guess then it would be up to the DIY organiser to decide on how much variation between the two was acceptable.

Again, a visual comparison makes it easy. It's possible programatically but you end up adding lots of code to recognise things that are very basic for a human to look at and understand.

(Although a route with just a few points, and then a track with a lot more points would be interesting to compare, you would probably have to interpolate points and compare to that, or compare the track points to a line between route points...)

And here's an example of a route (one point per routesheet instruction) overlayed with the actual GPX tracklog.

http://www.greenbank.org/misc/dean_gpx.jpg

Pretty easy to see that I went through almost all of the required points. Note that it was someone else's route that has a spurious point over near Monmouth in the west. :)
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 20 August, 2009, 03:02:20 pm
One other point, completely aside from cheating, is this: could it not give rise to *any* ride on which you had your GPS on, being able to be converted into an Audax? e.g. i did a 200 mile ride over the weekend, could I not *retrospectively* say that that was  DIY audax?
If the answer to that is "all DIY audaxes have to be pre-planned", then what is the reason WHY they should have to be preplanned?
You can't get validation for a ride you haven't entered.
Title: Re: Using tracklogs to validate DIY perms
Post by: Rich753 on 20 August, 2009, 03:25:31 pm
Expanding the topic slightly - is there any way a mobile 'phone can be persuaded to record where it is and when?

So when I send a text (or make a call) the service provider knows which service point I am using and hence broadly where I am, and knows exactly the time - is this information a) available & b) useful for providing a proof of passage  (ignoring for a moment areas with no service)
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 20 August, 2009, 03:31:01 pm
Expanding the topic slightly - is there any way a mobile 'phone can be persuaded to record where it is and when?

So when I send a text (or make a call) the service provider knows which service point I am using and hence broadly where I am, and knows exactly the time - is this information a) available & b) useful for providing a proof of passage  (ignoring for a moment areas with no service)

Dunno. You raise a good point though, this seems to me about proof of passage where there are not any shops or anywhere else to get a receipt from. A digital photo has been accepted by my local DIY organiser this year. Perhaps simply a picture of a verifiable road junction or other landmark is all that is really needed, we just need to prove we were there at a certain time after all, the route we took is not important.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 20 August, 2009, 03:41:43 pm
Expanding the topic slightly - is there any way a mobile 'phone can be persuaded to record where it is and when?

So when I send a text (or make a call) the service provider knows which service point I am using and hence broadly where I am, and knows exactly the time - is this information a) available & b) useful for providing a proof of passage  (ignoring for a moment areas with no service)

You don't even need to make a call. A phone will know the IDs of the base station(s) it is in contact with. An approximate location (i.e. usually accuracy of 10 miles in the countryside, 1 mile in cities) can be obtained from this alone. However, there isn't a complete public list of base station IDs and locations. I used to work on the project writing software to be intsalled on a Symbian OS phone to do just this (along with recording/calculating QoS metrics for calls made). It's pretty easy to get the details from the device. What you do with it is another matter.

The mobile network operators can locate a specific mobile phone with far greater accuracy as the receivers on the base stations can more precisely measure signal strength to/from the phone and perform some form of triangulation. This isn't available to the public though (although it is available via some private companies).

Mobile phones require a signal though, not much use if you're way out in the middle of nowhere (there was no Vodafone signal at the Devil's Staircase if I remember correctly, along with lots of the B709 between Langholm and Traquair).

GPS enabled phones will obviously know where they are without having to rely on a mobile signal, but that's blurring the lines again.

Simon's SPOTracker is a possibility as it is tamperproof and reliable (it doesn't need a mobile network to work). But there are data rentention issues as it doesn't keep all of your data forever.
Title: Re: Using tracklogs to validate DIY perms
Post by: Euan Uzami on 20 August, 2009, 04:35:42 pm
One other point, completely aside from cheating, is this: could it not give rise to *any* ride on which you had your GPS on, being able to be converted into an Audax? e.g. i did a 200 mile ride over the weekend, could I not *retrospectively* say that that was  DIY audax?

An interesting point is how would you check that the ride has followed the planned route?

Well, my question was why does there have to have even BEEN a planned route - why can a completely impromptu, unplanned ride just following your nose not be an audax.
But Greenbank has sort of answered that by saying the spirit of audax is "Completing what you set out to do". I presume 'set out to do' means having actually planned a route and THEN followed, rather than just 'ride a loop of x miles' but doing it ad-hoc and choosing where to go on the fly and following your nose.

Quote
 If you submitted your route as a GPX, I guess you could write a script to compare the original route and the generated track, and allowing for a generous error in the GPS, list any point where the route wasn't followed, or the track when too far off the route.  I guess then it would be up to the DIY organiser to decide on how much variation between the two was acceptable.
Hmm, an interesting consequence of this would be that it may make them MORE strict than calendar events.
If you applied that rule then i would have possibly failed offas dyke 'cos I'd forgot to transfer the road maps onto it for the south bit, so from hay to chepstow i just had to follow my nose and probably did actually deviate from the planned route a fair bit, but then again as far as i understand it calendar events run on the 'shortest route between controls' basis and the route given is only suggested.
Whether that's a good thing or not I don't know.

Thinking about it, I think there's a certain value in the 'shortest distance between controls' rule. In the same way that all olympic sports, e.g. javelin, pole vault, etc. have their origins in warfare, visiting set places on a bike ride does lend a certain amount of purpose to the ride (even if it is only to eat a fry up and drink tea!)

If this is not the case, is there  anything stopping the pre-planned route being "8,670 laps of manchester velodrome" ?  ;)

I know I'm sort of being deliberately obtuse but it sort of highlights that deviating from a 'controls' based approach might be a bit of a slippery slope to go down. The bottom of which could be an audax on a turbo ;) ::-)
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 20 August, 2009, 04:42:16 pm
I know I'm sort of being deliberately obtuse but it sort of highlights that deviating from a 'controls' based approach might be a bit of a slippery slope to go down. The bottom of which could be an audax on a turbo ;) ::-)

Audax on a turbo won't count as you don't actually ride any distance, you stay stationary !!! Your GPX wouldn't even demonstrate that your wheels went round !!!  As for laps of a velodrome, well, if you can demonstrate PoP, why not, I wouldn't do them myself though. It's not much different to rides like the Hebden Bridge Star or Up the Uts where the base is returned to several times.

I prefer the link up controls idea with a free route between them.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 20 August, 2009, 04:47:30 pm
Well, my question was why does there have to have even BEEN a planned route - why can a completely impromptu, unplanned ride just following your nose not be an audax.
But Greenbank has sort of answered that by saying the spirit of audax is "Completing what you set out to do". I presume 'set out to do' means having actually planned a route and THEN followed, rather than just 'ride a loop of x miles' but doing it ad-hoc and choosing where to go on the fly and following your nose.

"set out to do" doesn't mean having a planned route. It means visiting all of the listed controls, in the expected order. The route on any AUK organised event is free choice (although you're expected to follow the route if the ride qualifies for AAA points).

I can use any route I like on my DIY 200 up to Cambridge as back just as long as I get receipts that provide proof of passage of the places where I said I would (Putney, Broxbourne, Cambridge, Broxbourne, Putney).

If this is not the case, is there  anything stopping the pre-planned route being "8,670 laps of manchester velodrome" ?  ;)

Yes, the rules specifically exclude repeated circuits/laps of a set course. Can't find the reference though. (Audax points for the Mersey Roads 24 is an exception though.)
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 20 August, 2009, 04:49:57 pm
I think that Greenbank's view that you should finish what you set out to achieve has a lot of merit.  You set yourself a personal challenge and go out to achieve it.  

It's right that you can't, for example,  claim 2 points for packing half way round a 400 perm.  

I don't see the need for controls on DIY perms though,  if a pre-agreed route is followed.  Provided that the GPS track of the actual ride completed substantially matches a route agreed in advance and is up to distance then that's surely OK?  All correspondence can be elctronic, no brevet card is required and it would make life easier for all concerned, once bedded in.

Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 20 August, 2009, 04:54:58 pm
I think that Greenbank's view that you should finish what you set out to achieve has a lot of merit.  You set yourself a personal challenge and go out to achieve it.  

It's right that you can't, for example,  claim 2 points for packing half way round a 400 perm.  

I don't see the need for controls on DIY perms if a pre-agreed route is followed.  Provided that the GPS track of the actual ride completed substantially matches a route agreed in advance and is up to distance then that's surely OK?  All correspondence can be elctronic, no brevet card is required and it would make life easier for all concerned, once bedded in.


i think any rider who agrees to follow a set route on a DIY perm is increasing his chances of failure. It doesn't allow for local conditions on the day and the choice of a different route. It'll be their call of course. There is a thread on here today talking about avoiding the wind on the banks of the Trent, that would cause failure if the wrong bank is on the track.

It's an unwritten rule that one can't ride more than one event at once. So one could not claim for the first 200km of  a DNF 400km, that's not just Greenbanks view. You can't claim for events not entered. You enter the 400, not the 200. By the same token then, you can't submit a track for a ride you did two years ago. you didn't enter it.
Title: Re: Using tracklogs to validate DIY perms
Post by: CommuteTooFar on 20 August, 2009, 05:00:49 pm
Dave Lewis considered a 100km grimpeur where the rider spends all day riding up and down the various routes over Caerphilly mountain.  We were going to allow riders to do the sub rides in any order.  We decided against is as it would need too many controllers.
Title: Re: Using tracklogs to validate DIY perms
Post by: Manotea on 20 August, 2009, 05:00:55 pm
Quote
I know I'm sort of being deliberately obtuse but it sort of highlights that deviating from a 'controls' based approach might be a bit of a slippery slope to go down. The bottom of which could be an audax on a turbo ;) ::-)

Howzabout 18 laps of Richmond Park plus there and back from home?
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 20 August, 2009, 05:01:48 pm
I know I'm sort of being deliberately obtuse but it sort of highlights that deviating from a 'controls' based approach might be a bit of a slippery slope to go down. The bottom of which could be an audax on a turbo ;) ::-)

Howzabout 18 laps of Richmond Park plus there and back from home?

I didn't say any of that
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 20 August, 2009, 05:08:10 pm

i think any rider who agrees to follow a set route on a DIY perm is increasing his chances of failure. It doesn't allow for local conditions on the day and the choice of a different route. It'll be their call of course. There is a thread on here today talking about avoiding the wind on the banks of the Trent, that would cause failure if the wrong bank is on the track.

It's an unwritten rule that one can't ride more than one event at once. So one could not claim for the first 200km of  a DNF 400km, that's not just Greenbanks view. You can't claim for events not entered. You enter the 400, not the 200. By the same token then, you can't submit a track for a ride you did two years ago. you didn't enter it.

I agree completely, and organisers must have some degree of leeway to exercise their common sense, hence "substantially" rather than "slavishly" in mine above.

There's still the reliability of the technology to worry about, but within a few years, or possibly months, we'll all have GPS enabled watchphonesurf-o-fax's  backing up our bar-mount GPSs and tweeting our location direct to the forum every second anyway.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 20 August, 2009, 05:14:58 pm
Howzabout 18 laps of Richmond Park plus there and back from home?

19 laps is just over 200km (203.8km). One day I'll do it.
Title: Re: Using tracklogs to validate DIY perms
Post by: Salvatore on 20 August, 2009, 05:22:45 pm

If this is not the case, is there  anything stopping the pre-planned route being "8,670 laps of manchester velodrome" ?  ;)

I know I'm sort of being deliberately obtuse but it sort of highlights that deviating from a 'controls' based approach might be a bit of a slippery slope to go down. The bottom of which could be an audax on a turbo ;) ::-)


Blatant plagiarism, it you ask me.

Brevet Piste. (http://docs.google.com/View?id=dr7p4tj_25gsk6p7g8)
Title: Re: Using tracklogs to validate DIY perms
Post by: Euan Uzami on 20 August, 2009, 05:30:44 pm
"set out to do" doesn't mean having a planned route. It means visiting all of the listed controls, in the expected order.

hmm... fair enough - but if you can use a GPS tracklog as validation, then that would mean you don't need to have controls, or more specifically, you could have a pre-planned route but decide what controls to visit based on what happens to be open, or just what looks good - is it not the case that you can do that anyway? I'm sure one of the controls on the cambrian was not a specific place but "anywhere in church stretton" - some people went to a chip shop but others went to a caff.
Apologies if i'm missing the point.
Title: Re: Using tracklogs to validate DIY perms
Post by: Euan Uzami on 20 August, 2009, 05:32:47 pm
i think any rider who agrees to follow a set route on a DIY perm is increasing his chances of failure. It doesn't allow for local conditions on the day and the choice of a different route. It'll be their call of course. There is a thread on here today talking about avoiding the wind on the banks of the Trent, that would cause failure if the wrong bank is on the track.

It's an unwritten rule that one can't ride more than one event at once. So one could not claim for the first 200km of  a DNF 400km, that's not just Greenbanks view. You can't claim for events not entered. You enter the 400, not the 200. By the same token then, you can't submit a track for a ride you did two years ago. you didn't enter it.
And I presume that, tied to that, you can't *enter* two events that occur at the same time - so therefore you can't enter the 400 but also enter the 200 just in case you DNF the 400?  ;)
Title: Re: Using tracklogs to validate DIY perms
Post by: Euan Uzami on 20 August, 2009, 05:34:33 pm
Quote
I know I'm sort of being deliberately obtuse but it sort of highlights that deviating from a 'controls' based approach might be a bit of a slippery slope to go down. The bottom of which could be an audax on a turbo ;) ::-)

Howzabout 18 laps of Richmond Park plus there and back from home?
Well, where do you draw the line?
If it's "the route must not cross the same point twice" then existing calendar events would break that.
So therefore there can't be a strict definition as to what constitutes "laps of the same circuit", and is presumably down to the organisers/validator's discretion.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 20 August, 2009, 05:39:02 pm
I'm sure one of the controls on the cambrian was not a specific place but "anywhere in church stretton" - some people went to a chip shop but others went to a caff.

Yup, it's no different on a DIY ride. The controls are just town names with no indication of where/what will be used as a control. You just find something that will prove that you were at that place at a certain time.

hmm... fair enough - but if you can use a GPS tracklog as validation, then that would mean you don't need to have controls,

There are two possibilities that GPX files give, that I like anyway.

One, proof-of-passage through a certain place where there is no other way of getting a stamp or a receipt. Such as the Ewhurst example I gave earlier in the thread. I'd continue to use the other conventional receipts/stamps on the rest of the route and just rely on the GPX file for that one single control. This retains the idea of controls, but just allows you to create one or two extra GPX controls.

The second is rob's complete route idea. Submit a route (done on bikely, bikehike, gmap-pedometer, etc) to the DIY organiser. Validation consists of submitting the generated GPX tracklog and the DIY organiser/validator making sure that it mainly sticks to the proposed route and applies common sense.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 20 August, 2009, 05:43:31 pm
And I presume that, tied to that, you can't *enter* two events that occur at the same time - so therefore you can't enter the 400 but also enter the 200 just in case you DNF the 400?  ;)

The organiser should spot it and tell you that you've tried to enter both.

I suppose you could enter two DIY rides using two different DIY organisers, and you may get away with no-one noticing, but it's not in the spirit of the rules.

So therefore there can't be a strict definition as to what constitutes "laps of the same circuit", and is presumably down to the organisers/validator's discretion.

Exactly. An organiser wouldn't arrange a calendar event that has several loops of the same circuit. A DIY organiser shouldn't agree to a route using the same sets of controls (or picking different controls that make it essentially the same route).
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 20 August, 2009, 06:06:05 pm
One, proof-of-passage through a certain place where there is no other way of getting a stamp or a receipt. Such as the Ewhurst example I gave earlier in the thread. I'd continue to use the other conventional receipts/stamps on the rest of the route and just rely on the GPX file for that one single control. This retains the idea of controls, but just allows you to create one or two extra GPX controls.

Personally I don't think it would be a good idea to encourage mixed GPX/receipt based submissions as this would involve more work for the organiser tallying up the two (they'd have to bung the entire GPX into some software anyway, so checking receipts becomes an extra task). I recognise that there might end up being mixed submissions if something goes wrong such as batteries dying etc.


The second is rob's complete route idea. Submit a route (done on bikely, bikehike, gmap-pedometer, etc) to the DIY validator. Validation consists of submitting the generated GPX tracklog and the DIY organiser/validator making sure that it mainly sticks to the proposed route and applies common sense.

I don't see the advantage in submitting a full route tracklog for a proposed route. Why not make the 'route' just the shortest distance between as many controls as the rider wishes to submit(via bikehike etc.). These can of course include both conventional cafe stop controls as well as remote mountain passes to ensure minimum distance. That way, there is less checking required by the validator and less effort required by the rider in submitting their proposed route. After a ride, the rider submits their full tracklog and the validator just checks that it is of the at least the minimum distance and goes sufficiently close to the pre-agreed control points within time limits. This could all be done in a single piece of software and validated in seconds.
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 20 August, 2009, 08:26:50 pm
Why is the concept of controls relevant now that a whole route can be validated?
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 20 August, 2009, 09:05:36 pm
Why is the concept of controls relevant now that a whole route can be validated?

I don't feel particularly strongly about it, since this is just a thinking aloud thread, but I can see several advantages of using GPS validated controls over routes:


And a minor one, but one that could make a difference at an AGM

Title: Re: Using tracklogs to validate DIY perms
Post by: simonp on 20 August, 2009, 09:31:03 pm
What with this and discussion of LEL I do feel I should actually make an effort to attend for once.
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 20 August, 2009, 09:41:31 pm
Winter York arrow anyone?
Title: Re: Using tracklogs to validate DIY perms
Post by: Euan Uzami on 20 August, 2009, 09:46:52 pm

The second is rob's complete route idea. Submit a route (done on bikely, bikehike, gmap-pedometer, etc) to the DIY organiser. Validation consists of submitting the generated GPX tracklog and the DIY organiser/validator making sure that it mainly sticks to the proposed route and applies common sense.
Going by this idea, could a *sportive* actually ALSO be ridden as an audax?
You could say to the organiser, I am going to ride this route, on this day, I will have PoP from these points (the feed stations), it is a perfectly valid route of a valid distance, the fact that it's a sportive as well doesn't make it any less valid. You might not even tell them it's also a sportive. It would be PoP backed up by a tracklog.
...or is that just silly?
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 20 August, 2009, 09:56:37 pm
Going by this idea, could a *sportive* actually ALSO be ridden as an audax?

Potentially - although I would suggest that rides organised outside of AUK should generally not count for two reasons:  Firstly, there are generally broom wagons and additional support that nibble away at the Audax spirit of self-sufficiency and, secondly, becasue this might open flood-gates and leave organisers overwhelmed.
Title: Re: Using tracklogs to validate DIY perms
Post by: Panoramix on 20 August, 2009, 10:00:18 pm
Winter York arrow anyone?

It would be wrong not to attend the agm
It would be wrong to drive there
Mrs P may buy this ::-)

Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 20 August, 2009, 10:08:23 pm
Winter York arrow anyone?
Dinner Dart / After Dinner Dart.
Title: Re: Using tracklogs to validate DIY perms
Post by: simonp on 21 August, 2009, 12:06:05 am
Winter York arrow anyone?

Madness.  Where do I sign up?
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris N on 21 August, 2009, 08:33:11 am
Dinner Dart / After Dinner Dart.

Yep, I think so.
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 21 August, 2009, 11:36:43 am
* One or 2 people have mentioned in passing, the use of a photo as proof of passage.  Well, if the system is so relaxed is to allow this (ridiculously easy to falsify the timestamp), then really to worry about the possibility of forging a gpx seems like a non-issue.
(A photo would IMO have to include the bike, village sign, a news hoarding with todays headline, and the church clock, all in one pic. ;- )
(Sounds like a job for Photoshop)

* I wouldn't be worried about dirty or non-continuous tracks.  A 20-mile gap in a track is only like the 2-hour black hole that a rider goes into between controls, using the current system.  And, if I were checking a track, I would view a 'cleaned' track as suspect, and be much happier to receive an unprocessed one.

* The need for 'new rules' - this should be avoided as much as possible.  Make new 'guidelines for validators' by all means - these would not be subject to the AGM, and easy to fine-tune in light of experience.  Surely in general we want fewer rules, not more - and anyway, trying to get a pro-GPS reg through the AGM would be like trying to fry an egg on the back of a spoon.  

* Anyone wanting to take an active interest in the AGM should take note of the deadline for submitting motions to be discussed, which is end of September (for a written, seconded, proposal).  Given that due consideration should be given to precise wording etc etc, this deadline isn't far away.  Also note that once a proposal is tabled, either the proposer or the seconder is more or less bound to attend, or risk it being thrown out by the Chairman, without discussion.
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 21 August, 2009, 12:02:35 pm
Hmmm.  Unfortunately a change in the regulations would probably be required as 5.8 insists on the use of a brevet card as the sole proof of passage.  It needs to have something like "unless, in the case of a permanent ride, verification of completion of the ride is accomplished electronically.  This must be agreed in advance with the organiser."  added.

The alternative is things are fudged with "electronic brevet cards" in the form of emails that are replied to with the .gpx attached.  I think that would be too much of a fudge though, and the regs need to move with the times.

Guidance could be issued outside of the regulations as to how this should be interpreted, and that guidance can change over time as technology evolves.  

For example, I can envisage that, before too long, it will be possible for someone to write a web-based application that registers a ride with an organiser which is then approved before the ride starts, potentially automatically so the organiser doesn't have to do anything.  During the ride, the GPS device on the riders bike communicates with the application server and automatically validates it when it's completed satisfactorily.  Actually, if you take this line of thought to its conclusion you could do away with DIY perm organisers entirely but that's probably another thread..

The regs talk about arriving early and late at controls, but don't seem to insist that a ride actually has controls, in which case it is only the finish time for the whole thing that matters, so no out-of-time at controls to worry about.

Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 21 August, 2009, 12:08:44 pm
Hmmm.  Unfortunately a change in the regulations would probably be required as 5.8 insists on the use of a brevet card as the sole proof of passage.  It needs to have something like "unless, in the case of a permanent ride, verification of completion of the ride is accomplished electronically.  This must be agreed in advance with the organiser."  added.

Too specific:-

"unless, in the case of a permanent ride, verification of completion of the ride is accomplished by some other method.  This must be agreed in advance with the organiser."
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 21 August, 2009, 12:20:17 pm
* One or 2 people have mentioned in passing, the use of a photo as proof of passage.  Well, if the system is so relaxed is to allow this (ridiculously easy to falsify the timestamp), then really to worry about the possibility of forging a gpx seems like a non-issue.
(A photo would IMO have to include the bike, village sign, a news hoarding with todays headline, and the church clock, all in one pic. ;- )
(Sounds like a job for Photoshop)


Two DIY perm organisers have told me that a digital photo is acceptable. I am sure I read a few years ago on a web forum that it needn't include the rider nor a clock since the timestamp on the file is sufficient.
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 21 August, 2009, 12:31:28 pm

Too specific:-

"unless, in the case of a permanent ride, verification of completion of the ride is accomplished by some other method.  This must be agreed in advance with the organiser."

I agree.

EDIT:

Existing Regulation 5.8:

Brevet Cards: Brevet Cards shall be used for all AUK events. These will be issued before an event. It is the
responsibility of the rider to ensure the safe keeping of the card and that it is properly filled in at each control with
arrival time, control stamp and the controller’s initials, or with the required information in the case of
Information Controls. The Brevet Card is the sole means of proof that a ride has been completed. If any of the
control details are missing a rider may submit a written explanation with the card. The Validation Secretary may
then award the brevet if the explanation is considered reasonable.

Potential new 5.8:

Brevet Cards: Brevet cards shall be used for all AUK events unless, in the case of a permanent ride, verification of completion of the ride is accomplished by some other method.  Where a brevet card is used, it is the responsibility of the rider to ensure the safe keeping of the card and that it is properly filled in at each control with arrival time, control stamp and the controller’s initials, or with the required information in the case of Information Controls. If any of the control details are missing from the brevet card, a rider may submit a written explanation with the card. The Validation Secretary may then award the brevet if the explanation is considered reasonable.  In the case of permanent rides where proof of passage is established by a method other than the use of a brevet card, then that method must be agreed in advance with the organiser.

Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 21 August, 2009, 12:46:38 pm
Unfortunately a change in the regulations would probably be required as 5.8 insists on the use of a brevet card as the sole proof of passage.  

But the current (accepted) situation is that a DIY can be 'proved' by just a bundle of dodgy till receipts - OK, folded into an otherwise pristine brevet card.
What we need, is Brevet Bags.

The DIY Org is not, ultimately, the Validator - but like any Org, he/she 'pre-validates' the ride as part of the process.  So, the DIY Org can check the gpx, but ultimately still needs to countersign a Brevet Card for the ride, which then goes on into the system.

Of course, AUK is bound to go card-free (or partially so) at some future point - but lots of people love their brevet cards and keep shoe-boxes full of the things, so it won't be an easy process.

Quote
...a web-based application ...  During the ride, the GPS device on the riders bike communicates with the application server and automatically validates it when it's completed satisfactorily.  

Hmm - I can see that its already too late to re-print my 'science fiction' Arrivee article of 6 or 7 years ago - which describes exactly this scenario, - would seem like an old episode of Flash Gordon ...

Quote
The regs talk about arriving early and late at controls, but don't seem to insist that a ride actually has controls,

riders "are checked through a series of controls" [5.7]
the unwritten bit of this (someone really should write down all these unwritten rules) is that the controls exist to provide R&R, as much as for any other reason.  So a short event (say 100 or less) without an intermediate control should really be allowable - but isn't, as the regs stand.  Though there are 1 or 2 short events with only Infos I believe, which is a slight abuse in my view.

Quote from: Mseries
Two DIY perm organisers have told me that a digital photo is acceptable. I am sure I read a few years ago on a web forum that it needn't include the rider nor a clock since the timestamp on the file is sufficient.

Well what the Orgs find acceptable, in a given set of circumstances, is entirely up to their own discretion, and I'm all in favour of that.  The thing about DIYs is the Org builds up a relationship of trust with the rider.  But the simple fact is that the timestamp on a photo (digital or analogue) means nothing.
I've just geotagged a load of Sheila's photos from a trip a couple of months ago, and they were timestamped sometime in January, 2006.  I had to put in an offset of about 1160 days ...
Title: Re: Using tracklogs to validate DIY perms
Post by: Tewdric on 21 August, 2009, 12:50:26 pm
Can't the start and finish count as a "series of controls"?
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 21 August, 2009, 12:59:13 pm
Yebbut who would ride a 1-way 50km or 100km?

Somewhere in older versions of the regs it used to say something about controls being spaced not more than 80km apart.  This must have got downgraded into the guidelines somewhere - positively prescient!
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 21 August, 2009, 01:10:09 pm
I've taken photos as proof before, but I don't do it routinely.

If people ride my Alpine Star rides, and find the shops at summits closed, then I'll accept a photo.

I also accepted a photo of George Hanna, grinning like a naught schoolboy, at some suburban train station at the end of a ride. I wouldn't do that for everyone, but know George well enough to know he's not going to cheat on a 200km ride.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 21 August, 2009, 02:12:41 pm
Yebbut who would ride a 1-way 50km or 100km?

Somewhere in older versions of the regs it used to say something about controls being spaced not more than 80km apart.  This must have got downgraded into the guidelines somewhere - positively prescient!

I've done several one way 100km rides.

Putney to Cambridge a few times. Once to watch a football match with a 7.45pm kick off, another time for a wedding (the next day).
Cambridge to Putney. Coming back the day after the wedding.
Oxford to Putney via Aylesbury. Riding home the day after The Dean in 2008. Lovely warm sunny day, complete opposite of the weather the previous day!

100km rides do count as 1 FWC point in the Fixed Wheel Challenge, so there is a (no pun intended) point!

As for distances of >80km between controls, the Severn Across goes from Chepstow to Membury in one 100km jump. Most people stop at Malmesbury but it isn't an official control, no stamp/receipt required.

I've had DIY rides with 90km between controls approved, although I only go for these types of legs on rides longer than 300km. I try to keep legs under 70km (usually 4 legs of about 50km each) on a 200km DIY.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 21 August, 2009, 03:17:07 pm

Quote from: Mseries
Two DIY perm organisers have told me that a digital photo is acceptable. I am sure I read a few years ago on a web forum that it needn't include the rider nor a clock since the timestamp on the file is sufficient.

Well what the Orgs find acceptable, in a given set of circumstances, is entirely up to their own discretion, and I'm all in favour of that.  The thing about DIYs is the Org builds up a relationship of trust with the rider. 

That's pretty much what I wrote then deleted. It seems we agree. It's what our local DIY Organiser deems acceptable is what is important.

Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 21 August, 2009, 03:17:32 pm
There are many examples where the distance between controls is >80km, including this year's LEL :)
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 21 August, 2009, 03:20:17 pm
There are many examples where the distance between controls is >80km, including this year's LEL :)

Even on DIYs, hang on let's check, one moment. yes, the nexy DIY I shall ride has a leg loner than 80km
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 21 August, 2009, 04:01:10 pm
Its the 'light touch' innit?
Title: Re: Using tracklogs to validate DIY perms
Post by: PatC on 21 August, 2009, 06:03:08 pm
I also accepted a photo of George Hanna, grinning like a naught schoolboy, at some suburban train station at the end of a ride. I wouldn't do that for everyone, but know George well enough to know he's not going to cheat on a 200km ride.

Not sure about this statement. I'm not sure why one individual should be treated differently to anyone else, it all seems a bit arbitary to me.

I would have thought most riders join AUK to ride and not to cheat, fiddle tracklogs, forge receipts etc but in various discussions on this forum the standard reply has been that AUK deals in validated rides (and not simply trusting a rider to do the distance).   
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 21 August, 2009, 07:04:05 pm
Not sure about this statement. I'm not sure why one individual should be treated differently to anyone else, it all seems a bit arbitary to me.  

You're right. It is.

I can do things one of two ways. I can either enforce the rules unbendingly, or I can look to ways to validate riders who I believe to have acted in good faith. TBH the two cases I mentioned are the only two cases I've ever had. I've also accepted the word of another rider on an event, when a rider lost his brevet card. Oh, and postcards, hand written letters and smudged stamps on scraps of paper. I've also used letters from vicars myself, as well as a photo of a closed shop that I was meant to use as a control.

I look to validate, not to not validate. If you see what I mean.
Title: Re: Using tracklogs to validate DIY perms
Post by: Rich753 on 21 August, 2009, 10:37:17 pm
sounds like eminent common sense to em!
Title: Re: Using tracklogs to validate DIY perms
Post by: Rich753 on 04 September, 2009, 10:37:57 am
I have another thought/question ...

I'm only really interested in tracklogs as a mechanism to prove passage, not as a navigation device.  so could I do a ride, switch on the device for say a mile or so either side of a control point, enough to record my passage, then switch it off ready for the next control?

or is that a seriously dumb idea?

Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 04 September, 2009, 11:17:16 am
It would depend on how long it took to lock onto the signal.  This depends on (i) how long since you last locked on (clock drift) (ii) how far away you are from where you last had a lock on (normally only a problem if you've moved country or continent) (iii) how good the receiver is (iv) how much fog/cloud there is (I've had a receiver utterly fail to lock on with a lot of very low cloud) (v) amount of tree cover and/or buildings (vi) how much you are moving (I've found that most GPS get a lock much faster when you're stationary rather than moving).

This may mean that it could take any time from almost instantly locking on, to ten or fifteen minutes if you were really unlucky.

Alternatively, you could use something like an IgotU, which is relatively tiny, and if you set it to only record a data point every 30 seconds, it's internal battery should last over 24 hours.  If you need a longer runtime, you would have to reduce the logging interval (3 minutes or more is estimated to last 80 hours).
Title: Re: Using tracklogs to validate DIY perms
Post by: Cyklisten on 07 September, 2009, 12:09:34 am
On a couple of recent rides I have taken and uploaded photos via an iphone to facebook - largely for my wife to track my whereabouts. The time and date shows up for all to see - Danial, you may well have seen these already.
Also, having loaded iLife onto my Mac I was quite suprised to be presented with (in iPhoto) a world map with drop pins showing the location of my photos. Obviously the location is embedded in the picture file. Perhaps this could be refined and used?
Just my ten penn'orth. Apologies if I'm repeating anything up thread as I have only skimmed through quickly.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 11 December, 2009, 07:08:39 pm
I'm now ready to test a system that myself, Steve Snook and Pete Coates have been working on since the AGM.

If you're a regular DIY rider, have a GPS unit, and fancy a couple of free perms, then get in touch.

You'll need to ride in the next few weeks. Also, you'll not get a brevet card, but you will get AUK validation if you complete your ride.

Hat tip to Steve for his work on this. Big hat tip to Pete Coates for his programming.

(what's that you say, Danial? Possibility of offering AAA points on DIY rides? Tell me more...)
Title: Re: Using tracklogs to validate DIY perms
Post by: Bianchi Boy on 13 December, 2009, 05:51:08 pm
Danial when are you planning to accept logs. I might be tempted to do a 200 between Christmas and new year. If I can avoid beer for long enough!
Title: Re: Using tracklogs to validate DIY perms
Post by: RichForrest on 13 December, 2009, 06:44:49 pm
You should have mine now as I've just sent it  :thumbsup:
Hope it's ok  :)

Rich.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 13 December, 2009, 06:53:25 pm
Danial when are you planning to accept logs. I might be tempted to do a 200 between Christmas and new year. If I can avoid beer for long enough!

Drop me a line, and I'll send you the details.

I have about 15 validations remaining, so if anyone else wants to have a go at a gpx DIY, and you already know the drill with DIYs, then get in touch.
Title: Re: Using tracklogs to validate DIY perms
Post by: RichForrest on 13 December, 2009, 08:31:36 pm
If this works ok and takes off. It'll make diy rides a lot easier to organise/route and ride.
You could do a ride straight from home/your village at any time of day or night even if your village doesn't have a shop for a receipt.
You can ride straight through your control place however small it is without stopping or worrying if the shop is still open. Or wasting time trying to find somewhere for a receipt in a place you don't know.

Big :thumbsup: :thumbsup: to Danial, Steve and Pete for the work you've put into this.
Title: Re: Using tracklogs to validate DIY perms
Post by: Weirdy Biker on 13 December, 2009, 08:40:39 pm
Yeah, if this works, it is going to be an absolutely fantastic thing.

I've been getting increasingly pissed off with DIYs due to them always being over-distance and the real sense of being under time pressure all the time.  In reality, the minimum speed for a DIY is more like 16kph to 17kph, rather than 14.3kph, especially in the South East where it just isn't sensible to take the "shortest route" due to traffic volumes.

This will restore balance to the force  :)
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 13 December, 2009, 08:43:56 pm
Need to work out a couple of DIYs from here to use over the next month or two.

Sounds brilliant!

Edit: Even as I typed that I realised - I don't need a start control - Home will do, is that right?
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 13 December, 2009, 09:18:56 pm
....... so if anyone else wants to have a go at a gpx DIY, and you already know the drill with DIYs, then get in touch.
Sorry if this is a dumb question, but are you offering this (test?) service for only your own area of responsibility or can anyone have a go? I've just done a DIY 320k in Essex/Suffolk/Cambridgeshire region which I'd normally snail mail to Andy U. but I'd happily send you the tracklog .gpx file if you're willing to validate the ride - ?

If this works ok and takes off. It'll make diy rides a lot easier to organise/route and ride. .......
Big :thumbsup: :thumbsup: to Danial, Steve and Pete for the work you've put into this.
Very heartily seconded.
Title: Re: Using tracklogs to validate DIY perms
Post by: RichForrest on 13 December, 2009, 09:32:07 pm

Edit: Even as I typed that I realised - I don't need a start control - Home will do, is that right?

What I did was send Danial an email last night with a scanned entry form and an autoroute file of the route I intended to ride, he has autoroute so it was easy to check.
The ride I did today started and ended at home so I didn't need to stop at the garage to get a start time, I rode straight through 3 out of the 4 controls and stopped wherever I wanted.
The gpx file was sent to Danial when I got back. He's said it's ok and is on the way for validation.

Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 13 December, 2009, 09:37:17 pm

Edit: Even as I typed that I realised - I don't need a start control - Home will do, is that right?

What I did was send Danial an email last night with a scanned entry form and an autoroute file of the route I intended to ride, he has autoroute so it was easy to check.
The ride I did today started and ended at home so I didn't need to stop at the garage to get a start time, I rode straight through 3 out of the 4 controls and stopped wherever I wanted.
The gpx file was sent to Danial when I got back. He's said it's ok and is on the way for validation.



Awesome  :thumbsup:
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 13 December, 2009, 09:46:21 pm
Awesome  :thumbsup:
Absolutely. My 300k turned out to be 320k and due to a variety of reasons, including the usual lack of riding ability(!) I made it back only 15 minutes inside the time limit. A great deal of time was lost faffing around at "controls". If we can get to a system where you can literally just ride from your door, take as scenic and quiet a route as you like, avoiding busy roads without complex calculations involving comparisons with theoretical shortest routes, and just do the distance and get the ride validated it would be truely brilliant!

For my ride though, I'd sent my entry to Andy U. in advance and carried a pre-purchased Brevet as usual so I don't know if it qualifies for Danial's experiment or not - ?
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 13 December, 2009, 09:51:37 pm
Yeah, if this works, it is going to be an absolutely fantastic thing.

I've been getting increasingly pissed off with DIYs due to them always being over-distance and the real sense of being under time pressure all the time.  In reality, the minimum speed for a DIY is more like 16kph to 17kph, rather than 14.3kph, especially in the South East where it just isn't sensible to take the "shortest route" due to traffic volumes.

This will restore balance to the force  :)

Ermm, I hate to piss on your chips, but for the moment, the shortest distance rule still applies. Sorry.
Title: Re: Using tracklogs to validate DIY perms
Post by: Ian H on 13 December, 2009, 09:58:04 pm
If this works ok and takes off. It'll make diy rides a lot easier to organise/route and ride.

Oh dear. Should I resign now? I think I'm only joking.
Title: Re: Using tracklogs to validate DIY perms
Post by: Weirdy Biker on 13 December, 2009, 10:22:27 pm
Yeah, if this works, it is going to be an absolutely fantastic thing.

But for the moment, the shortest distance rule still applies. Sorry.

Illogical, but if them's the rules, so be it.  
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 13 December, 2009, 10:24:48 pm
....... Ermm, I hate to piss on your chips, but for the moment, the shortest distance rule still applies. Sorry.
Yeah, but..................at least this way I can work out the route I actually want to ride, as opposed to something I have to compromise by ghosting it against a theoretical route, even if it means nominating thirty controls to create a "shortest possible". Then just ride straight through all the "controls" and stop at the really good cafe that otherwise wouldn't have worked as a control. I've "visited" all the requisite controls, in the necessary sequence; I just haven't stopped at all of them. The .gps track proves my ridden distance, job done.

Or am I missing something? ..... That's usually the explanation!
Title: Re: Using tracklogs to validate DIY perms
Post by: Panoramix on 13 December, 2009, 10:26:24 pm
Yeah, if this works, it is going to be an absolutely fantastic thing.

But for the moment, the shortest distance rule still applies. Sorry.

Illogical, but if them's the rules, so be it. 

You can always add extra controls in the middle of nowhere to bring the theoretical distance up.

Edit: PloddinPedro was faster!
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 13 December, 2009, 10:27:29 pm
Yeah, if this works, it is going to be an absolutely fantastic thing.

But for the moment, the shortest distance rule still applies. Sorry.

Illogical, but if them's the rules, so be it.  

Why? There's a minimum distance between your stated controls. You may or may not ride that route. Often, the more direct route implies trunk routes and unpleasantness, in which case you choose a (usually longer) different route. The shorter route still applies.

Title: Re: Using tracklogs to validate DIY perms
Post by: Weirdy Biker on 13 December, 2009, 10:32:16 pm
Panoramix/PloddinPedro:  Hadn't thought of that.  Although we'll need to wait and see if this is how it pans out.  There may be restrictions.

ChrisS: Illogical because your proof of passage is the tracklog.  I guess implicitly I was anticipating Panoramix/PloddinPedro's responses, but without the need to write down all of the control towns.  Thinking about it, it's obvious you need to agree the controls in advance.
Title: Re: Using tracklogs to validate DIY perms
Post by: MattH on 13 December, 2009, 10:35:15 pm
One thought on the shortest route not being the one you'd want to ride - you can trivially add a "control" point or two that is on the route you actually want to ride away from the horrible main road. There doesn't have to be anything there, just a point on the road that your track crosses. Unless I'm misunderstanding how Danial will be validating these.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 13 December, 2009, 10:37:38 pm
It's not a question of logic, more of ease of checking. And consistency acorss DIYs, and about easing ourselves into a new way of validation.

That's not to say actual route submission won't ever happen, but not just now.

And no Matt, you're spot on. if you don't have to stop at controls anymore, you can be a bit more liberal with them.

However, if riders start to send 30-control DIY entries, then I'll have  insist on an autoroute file.
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 13 December, 2009, 10:40:44 pm
I had assumed it worked like this (for DIYs):

1. You decide on a set of controls that define the minimum distance using the usual means.
2. You enter the ride.
3. You ride the ride with a GPS and record a GPX that proves you passed through your controls at permitted times.
4. You submit GPX and get the points.

The Great Things about GPX validation is merely flexibility and convenience. You can submit controls that don't have traditional means of validation (Eg: Some village in the middle of nowhere, that you'll pass through in the middle of the night) which includes your Home. and you don't need to stop for traditional PoP at controls - you pass on through and choose where you want to stop to rearm.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 13 December, 2009, 10:50:49 pm
Going back to Danial's original post ..........
I'm taking a proposal to the next commitee meeting, to allow me to test using tracklogs and GPX files to check and validate DIY perms on my patch. I hope that the commitee will allow me a temporary waiver to validate rides without the normal proof of passage, such as stamps and receipts.
This is long thread and I haven't made the effort to read it all in detail so apologies if I've missed the plot, but it seems to me the whole point of validating a ride with a .gpx tracklog file is to replace the paper receipts/stamps from controls method. If the validity of the .gpx track is accepted, it seems to me to open up a whole new flexibility for DIY rides, which I would expect could lead to a lot more participation in such rides. I've lost count of the number of people I've met and with whom I've discussed the RRTY for example but whose eyes glaze over when I rabbit on about how useful it is to throw in some DIY rides and then go on to explain how it's done - admittedly they tend to be the non GPS users, but still .....

Skimming through the thread I see there was a big gap between early September when the initial debate paused and Danial's 10th Dec post advising he was going to run the experiment; so I guess we don't know exactly how it's intended to work. Patience required here I suspect - we don't want to overwhelm the poor chap!
Title: Re: Using tracklogs to validate DIY perms
Post by: simonp on 13 December, 2009, 10:57:42 pm
I think it gives a potential advantage to owners of GPS devices over and above the navigation side.  Maybe that's unfair?

Anyway, it would stop me worrying about whether I can get away with controlling at Tesco vs Spar.  Spar's cash point charges for withdrawals, you see.  Both are close enough to the "official" start point but the Tesco is on my route.  Problem is, it says "Fulbourn Tesco" not "Cherry Hinton Tesco" so I'd have to get that cleared with Andy.  It's a level of hoop jumping that just gets in the way.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 13 December, 2009, 11:04:33 pm
It's not a question of logic, more of ease of checking. And consistency acorss DIYs, and about easing ourselves into a new way of validation.

That's not to say actual route submission won't ever happen, but not just now.

And no Matt, you're spot on. if you don't have to stop at controls anymore, you can be a bit more liberal with them.

However, if riders start to send 30-control DIY entries, then I'll have  insist on an autoroute file.
That's exactly where my thoughts were heading. This sort of mirrors my current practice, insofar as I compose the route on Autoroute, as recommended in the AUK guide and submit it for preapproval (or I would if Andy had the same version of Autoroute as me - as it is, I just send a list of postcodes, etc and he has to plug them into his version).

It may be however, that a debate could emerge here (or may already have occurred?) around the possibility of creating a two-tier system whereby those with the technology might be perceived as having an unfair advantage over those without it. Not sure I want to get into that, but it's a thought .........

Pre-post edit: Bridget's made a similar observation. There are of course other ways in which it might be argued that some people have advantages over others - being retired, being in a geographical area with more calendar events, etc. Why should this be any different?

....  It's a level of hoop jumping that just gets in the way.
It's just this sort of faff it would be great to lose.
Title: Re: Using tracklogs to validate DIY perms
Post by: MattH on 13 December, 2009, 11:24:29 pm
I like this idea for the lack of hoop jumping.

I've done a lot of rides this year where I simply haven't bothered DIYing them as the whole faffage of getting receipts, not mislaying them, worrying about where to get one when the one cash point in a little village isn't working and it is 3am, etc. gets in the way of riding a bike, which is what I want to do. However, I do like having the challenge of riding inside time limits and having an annual record.

I've been doing the UMCA Year Rounder this year, which allows gps proof of passage. That has worked really well (with a couple of problems where Garmin crashes resulted in corrupt files, so out comes the xml editor to fix them...). The UMCA system is a bit simpler (you just provide a link to something like Garmin Connect where you've uploaded your ride afterwards), but then they don't have the concept of deciding what you are going to do and doing it, which isn't the AUK way. You just go out and ride, and if your ride is longer than the minimum distance and above the minimum average speed by the time you fiinish then it counts. Not better or worse, just different.

If gps proof had been available this year, then I'd have done a lot more AUK validated rides. Fingers crossed that the system works!
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 14 December, 2009, 07:43:53 am
I think it gives a potential advantage to owners of GPS devices over and above the navigation side.  Maybe that's unfair?

It does indeed give an advantage to GPS owners, as the developing system appears to be a lot less admin-heavy. However I wouldn't say it was unfair. You can get a basic GPS unit these days for the same price as a basic wheel, and a large enough proportion of riders now use them instead of/along with routesheets.
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 14 December, 2009, 09:10:48 am
I think it gives a potential advantage to owners of GPS devices over and above the navigation side.  Maybe that's unfair?

It does indeed give an advantage to GPS owners, as the developing system appears to be a lot less admin-heavy. However I wouldn't say it was unfair. You can get a basic GPS unit these days for the same price as a basic wheel, and a large enough proportion of riders now use them instead of/along with routesheets.
I think "the same price as a basic wheel" is still an unfair barrier to this form of validation (which could easily save an hour on a 200k); don't forget it also assumes ownership of a modern computer, plus having the 'Ologys to know how to integrate all the bits.

However, balancing this is the reduction in car-dependence (it's tough to run a car for less than the GPS costs!), and car USE, so I may be in favour (as a non-GPS user, I stress).
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 14 December, 2009, 09:16:40 am
I'm a tincy wincy bit confused.

Do I:

(a) Enter a ride, specifying key points ("controls"), then submit my gpx as proof that I visited those places and it added up to the minimum distance?

or

(b) Enter a ride, not specifying where I'm going - just call it a DIY 200 - and then ride my bike until 200 comes up on the odometer, and submit this gpx as proof of distance ("passage" is meaningless in this context as no intended destinations were previously stated).
Title: Re: Using tracklogs to validate DIY perms
Post by: RichForrest on 14 December, 2009, 09:21:43 am
You enter as you would a normally do on a DIY, the only difference is you don't need to collect receipts.
Title: Re: Using tracklogs to validate DIY perms
Post by: Weirdy Biker on 14 December, 2009, 09:42:57 am
Chris.  My reading is (a).

A thought.  This will certainly make validation of the LEJOG permanent much easier - I've had a couple of riders that I've had to comment on the proof of control they submitted being based more on trust than evidence.  One came this >< close to not getting a 1400km brevet validated because of it.  A gpx log would have solved this more easily.

It will be interesting to see if riders go down the "submitting lots of controls" for that ride.  It would end up like a Domesday book for the 21st century  ;D
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 14 December, 2009, 10:19:28 am
Yes - upthread you'll see that's how I interpreted too (prior to my confusion) - and Rich has now ridden a DIY in that fashion, so I'll go with that.

Top work chaps  :thumbsup:.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 10:19:47 am
I'm a tincy wincy bit confused.

Do I:

(a) Enter a ride, specifying key points ("controls"), then submit my gpx as proof that I visited those places and it added up to the minimum distance?

or

(b) Enter a ride, not specifying where I'm going - just call it a DIY 200 - and then ride my bike until 200 comes up on the odometer, and submit this gpx as proof of distance ("passage" is meaningless in this context as no intended destinations were previously stated).
The rules still say we need to enter with a list of controls and the shortest route between then must be at least the proposed distance for the event.

Are all DIY organisers participating in this trial ? If not will Danial process out of area entries ?
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 10:35:31 am
You can get a basic GPS unit these days for the same price as a basic wheel,

Example ? Something to record my journey would suit me fine. I don't need a device to tell me where to go.
Title: Re: Using tracklogs to validate DIY perms
Post by: Paul D on 14 December, 2009, 10:36:11 am
I've already offered my services to test this out, based on the assumption that I'll just specify a couple of tiny villages either end of the Wylye valley as 'ride-through' controls, rather than Frome - Amesbury (which is way over distance if you chose lanes rather than the A303).

I'm also very keen on getting this off the ground by May next year, as we want to ride the Applecross pennisula as part of our Scottish DIY 1300 and gpx validation will solve any problems finding controls in one-house villages.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 14 December, 2009, 10:40:07 am
Just a stream of thought ................... there is perhaps an evolution in progress here. At the moment we seem to be moving to a system as described by RichF (step 1) i.e. same as always, just no paperwork. Then step 2 is to say OK, now no need to have retail premises at the "controls", just a series of control locations around which the minimum per Autoroute is above [200]k. Then step 3 is: because you want to ride a complex route, so as to avoid unpleasant roads without going vastly overdistance, you bung in far more control points than ever before. Step 4 is to say that because we now need [30] control points to generate the minimum requisite distance and still have our crinkly route, to ease the admin. the route has to be submitted as an Autoroute file (so the validator doesn't have to sit and plug your 30 control points into his own PC).

So far, so good - we're still using a process that bears a strong resemblance to current practice.

Step 5: why bother with Autoroute? Why can't I generate a route/track in say Mapsource instead, submit it in advance for clearance, then ride it and send in the tracklog. the validator throws both up on screen; they match; bingo, validation OK. Admitted, the validator has to have Mapsource, etc. himself, but that's doable.

Step 6: why submit in advance? After all, I don't always get confirmation of approval of my draft route/controls at present - if I ride it before confirmation, I do so at my own risk that there's a flaw in my draft (I'm not talking about the Entry Form - that goes in on spec in advance as normal)

Step 7: why bother drafting an intended route to submit beforehand? Why not just go for a ride (at the requisite speed), record your track, get home after [230]k, send in the tracklog and claim a 200k DIY? I've been a "long distance cyclist" for the duration of the ride, which what it's all about, no?

OK there's the Entry form thing - why? For the insurance. But I have CTC insurance; I'm not bothered. So is it insurance for the "Organiser/organisation" then? How so? What's the risk for them?

Stream of conscientiousness ends ................
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 14 December, 2009, 10:48:08 am
You can get a basic GPS unit these days for the same price as a basic wheel,

Example ? Something to record my journey would suit me fine. I don't need a device to tell me where to go.

You can pay as little as £80 (cable sourced separately) for a basic yellow Garmin eTrex if you hunt around on eBay. Software is free. That'll give you an appropriate tracklog. Can also be used for navigation, no maps but you can put in pre-programmed routes that tell you what to do. Mine got me round LEL with no problems.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 10:50:58 am
Firstly, we need to have all DIY organisers following the same system so that all riders can. Then let it develop.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 14 December, 2009, 10:56:53 am
Step 7: why bother drafting an intended route to submit beforehand? Why not just go for a ride (at the requisite speed), record your track, get home after [230]k, send in the tracklog and claim a 200k DIY? I've been a "long distance cyclist" for the duration of the ride, which what it's all about, no?

The existing rules are built around describing your intentions and then doing the ride. With the current rules, if you pack at 630km into a 1000km ride you get nothing. With the rule proposed above you'd be able to claim for 600km (as long as you were within time). 630km is still a long distance cycle ride, but it's not what you set out to do.
Title: Re: Using tracklogs to validate DIY perms
Post by: dasmoth on 14 December, 2009, 10:59:00 am
A bit of Googling suggests logging-only devices can be had for ~UKP50.  No experience of any of these though, and since the ability of GPS devices to pick up a signal under trees, etc., seems to have increased dramatically over the last few years, it's probably worth doing a bit of research before you buy.

I could imagine it might be possible to get a bargain deal on a basic eTrex from someone who's decided to upgrade to a mapping unit.
Title: Re: Using tracklogs to validate DIY perms
Post by: Jaded on 14 December, 2009, 10:59:38 am
Firstly, we need to have all DIY organisers following the same system so that all riders can. Then let it develop.

Why?

Surely it is better to have one or two doing it and ironing out any unforeseen issues before putting it across the whole country.

What you are proposing would in all likelihood, mean it was never introduced.
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 14 December, 2009, 11:04:02 am
A bit of Googling suggests logging-only devices can be had for ~UKP50.
Paging Bridget ... !

I can't remember exactly how these work (clearly I wasn't listening to Simon for the whole 500k together) - can the admin be done purely on the Web with these? So you wouldn't even need your own PC? Just check/renew the batteries from time-to-time.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 11:11:15 am
Firstly, we need to have all DIY organisers following the same system so that all riders can. Then let it develop.

Why?

Surely it is better to have one or two doing it and ironing out any unforeseen issues before putting it across the whole country.

What you are proposing would in all likelihood, mean it was never introduced.
To make it inclusive, not exclusive.



Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 14 December, 2009, 11:14:16 am
Firstly, we need to have all DIY organisers following the same system so that all riders can. Then let it develop.

Why?

Surely it is better to have one or two doing it and ironing out any unforeseen issues before putting it across the whole country.

What you are proposing would in all likelihood, mean it was never introduced.
To make it inclusive, not exclusive.
But we don't have a level playing field at present - different validators have different attitudes/procedures.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 11:16:20 am
Firstly, we need to have all DIY organisers following the same system so that all riders can. Then let it develop.

Why?

Surely it is better to have one or two doing it and ironing out any unforeseen issues before putting it across the whole country.

What you are proposing would in all likelihood, mean it was never introduced.
To make it inclusive, not exclusive.
But we don't have a level playing field at present - different validators have different attitudes/procedures.
That's what I am referring to first and foremost.

A multi-tier system based on where someone lives is wrong in a national organisation.
Title: Re: Using tracklogs to validate DIY perms
Post by: Jaded on 14 December, 2009, 11:19:32 am
Firstly, we need to have all DIY organisers following the same system so that all riders can. Then let it develop.

Why?

Surely it is better to have one or two doing it and ironing out any unforeseen issues before putting it across the whole country.

What you are proposing would in all likelihood, mean it was never introduced.
To make it inclusive, not exclusive.


Ah. I get it. You want everyone to be excluded.

I did a DIY this year - in the year I first did a points carrying Audax. Unlike some people my life cannot revolve around calendar events and whilst I found the planning of the DIY interesting it was also a worry to find an appropriate checkpoint for each of the controls I did. A GPS track accreditation would in all probability get me out doing more Audax. I don't see how forcing a delay until everyone does it benefits anyone.

Maybe you don't think someone like me should be doing Audaxes?
Title: Re: Using tracklogs to validate DIY perms
Post by: simonp on 14 December, 2009, 11:20:55 am
A bit of Googling suggests logging-only devices can be had for ~UKP50.
Paging Bridget ... !

I can't remember exactly how these work (clearly I wasn't listening to Simon for the whole 500k together) - can the admin be done purely on the Web with these? So you wouldn't even need your own PC? Just check/renew the batteries from time-to-time.

This seems unlikely.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 14 December, 2009, 11:22:47 am
A bit of Googling suggests logging-only devices can be had for ~UKP50.
Paging Bridget ... !

I can't remember exactly how these work (clearly I wasn't listening to Simon for the whole 500k together) - can the admin be done purely on the Web with these? So you wouldn't even need your own PC? Just check/renew the batteries from time-to-time.

Bridget's SPOTracker probably isn't the ideal tool. The points it logs are too infrequent (every 15 minutes maximum) which could make it tricky to prove you went to a specific control location, and (if I remember correctly) the data isn't held on the server for very long (24 hours).

The other problem is that it, and other tracking devices, are quite easy to turn off and there's no warning that they have been turned off. I've also had times where the GPS that's mounted infront of me has turned itself off (vibration or dud batteries) and I haven't noticed for a period of time (despite it being right infront of me). At least with paper receipts it's my fault if I forget to get one at a nominated control, or lose it before submission.
Title: Re: Using tracklogs to validate DIY perms
Post by: TOBY on 14 December, 2009, 11:23:45 am
Step 7: why bother drafting an intended route to submit beforehand? Why not just go for a ride (at the requisite speed), record your track, get home after [230]k, send in the tracklog and claim a 200k DIY? I've been a "long distance cyclist" for the duration of the ride, which what it's all about, no?

The existing rules are built around describing your intentions and then doing the ride. With the current rules, if you pack at 630km into a 1000km ride you get nothing. With the rule proposed above you'd be able to claim for 600km (as long as you were within time). 630km is still a long distance cycle ride, but it's not what you set out to do.

Unless it's an ECE and the first 600km was made up by a Calendar event, then you can pack and still get 6 points.
Title: Re: Using tracklogs to validate DIY perms
Post by: Jaded on 14 December, 2009, 11:24:20 am
A multi-tier system based on where someone lives is wrong in a national organisation.

Every Audax I've entered (apart from those run by the same organiser) has had a different approach, different web info, a different style of route sheet, a different response time, a different quality of what is provided at controls, etc.

The multi-tier is there now.

Audax is about odd people riding silly distances, not about blandness and homogenisation.  :thumbsup:
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 14 December, 2009, 11:26:37 am
there is perhaps an evolution in progress here.

How rapid does evolution have to be before it becomes revolution?

To be anything more than a 'trial' - this needs to be announced in Arrivee or the Handbook.  Even if its only one sentence.
The Handbook is nearly ready to print and Arrivee for February is, I think, already full to bursting.  The following Arrivee wouldn't hit the doormats until May.   If it needs committee approval then next May is the earliest it can be rolled out.


Quote
Step 5: why bother with Autoroute? Why can't I generate a route/track in say Mapsource instead, submit it in advance for clearance, then ride it and send in the tracklog. the validator throws both up on screen; they match; bingo, validation OK. Admitted, the validator has to have Mapsource, etc. himself, but that's doable.

Not necessary - free software will display either track as a 'shape' and will show that the two tracks match (if that is thought to be important).  Validation IMO would be more about checking that the ride gpx hasn't been recorded in a car, copied from someone else or fabricated in Mapsource or Google Maps.  But that's all in hand, I believe.  Whatever the process is, it has to be quick and easy, for the organiser/validator.


Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 11:28:32 am
Firstly, we need to have all DIY organisers following the same system so that all riders can. Then let it develop.

Why?

Surely it is better to have one or two doing it and ironing out any unforeseen issues before putting it across the whole country.

What you are proposing would in all likelihood, mean it was never introduced.
To make it inclusive, not exclusive.


Ah. I get it. You want everyone to be excluded.

I did a DIY this year - in the year I first did a points carrying Audax. Unlike some people my life cannot revolve around calendar events and whilst I found the planning of the DIY interesting it was also a worry to find an appropriate checkpoint for each of the controls I did. A GPS track accreditation would in all probability get me out doing more Audax. I don't see how forcing a delay until everyone does it benefits anyone.

Maybe you don't think someone like me should be doing Audaxes?
You sound like you are getting agitated Ja. I have done many DIY perms with three different organisers in the last four years and for some, especially in the 2008/09 season had to worry about making the distance and finding controls etc like you did. A GPS track would have made it much easier for me to get the proof of passage. I'd like to do that. But I can't.

I am not suggesting forcing  a delay. Maybe just assign one or more willing organisers to administer the GPX system for all riders not just those in their area.  I acknowledge that;s not what I said a moment ago but my point is about the same system for everyone.

Quote
Maybe you don't think someone like me should be doing Audaxes?
A negative question is hard to answer.  It's not about you, it's about allowing everyone to take advantage of a better system not just those who live in a particular part of the country.
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 14 December, 2009, 11:31:30 am
The other problem is that it, and other tracking devices, are quite easy to turn off and there's no warning that they have been turned off. I've also had times where the GPS that's mounted infront of me has turned itself off (vibration or dud batteries) and I haven't noticed for a period of time

I don't see this as much of an issue at all.  Likewise leaves on the line dense tree cover.
Even a very incomplete track is going to be far more informative than a handful of grubby receipts, some of which have the wrong date on and some of which carry the address 'Rochdale'.
Title: Re: Using tracklogs to validate DIY perms
Post by: Jaded on 14 December, 2009, 11:34:27 am
it's about allowing everyone to take advantage of a better system not just those who live in a particular part of the country.

If there is never any intention of rolling it out across the country I'd agree with you. If however there is an implementation that results, temporarily, in some areas having a slightly different way of validating a DIY which ultimately results in everyone getting a better deal, I see no problem.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 14 December, 2009, 11:37:06 am
I think you're missing the point that Danial will accept entries from all over the country using this system, not just for the area of the country he looks after for normal DIYs.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 11:40:02 am
Greenbank, is that so ? You are right.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 11:41:58 am
it was this on the first post that made me think otherwise

"I'm taking a proposal to the next commitee meeting, to allow me to test using tracklogs and GPX files to check and validate DIY perms on my patch"
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 14 December, 2009, 11:44:48 am
You can get a basic GPS unit these days for the same price as a basic wheel,
Example ? Something to record my journey would suit me fine. I don't need a device to tell me where to go.

Don't worry - personal tracking will be mandatory for all, within the cycling lifetime of most people here.
Title: Re: Using tracklogs to validate DIY perms
Post by: MattH on 14 December, 2009, 11:49:26 am
Don't worry - personal tracking will be mandatory for all, within the cycling lifetime of most people here.

And as you'll have to log all intended journeys in advance with the relevant government department, it will make all the entry and validation stuff much easier - just get the organiser to check the latest leaked personal movements file from the gov, and compare your registered movements with the logged ones  ;D
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 14 December, 2009, 12:57:20 pm
At the moment, this is just a trial. It might not even become an integral part of AUK validation, though I hope it will.

We're still working out the mechanics and processes that will underpin validation by GPX, and the tests we're conducting with volunteer riders are proving to be very useful in this work. The intention is to take the trial findings to the next committee meeting, along with a proposal for the next steps.

Until then, I'd strongly advise not to get drawn into a heated debate about a process that does not yet exist.
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 14 December, 2009, 01:42:00 pm
Example ? Something to record my journey would suit me fine. I don't need a device to tell me where to go.

I've got an IgotU GPS logger, which is slightly smaller than a packet of matches, and cost me less than £40.  Depending on how fast you log points, it'll probably run for several days on its internal batteries.

I can't find one quite that cheap at the moment, but I didn't hunt around much.  I wonder if you could use the GPS units that an increasing number of phones have now.  As long as you can output the data as GPX, and it's got adequate time resolution I don't see why that shouldn't be an option.

One thing to consider however, is that the small units, with relatively small and poor aerials, often don't log as accurately, or lock on to the satellites as reliably as bigger, handlebar mounted devices.

The logs from my Satmap Active 10 are generally very accurate, and only tend to have significant issues in places like the City, with a large number of very tall buildings blocking out large areas of the sky.  The IgotU can often bounce hundreds of feet off of the route that I know I was on, for no obvious reason.

The IgotU can be configured to ignore it's single pushbutton, which is a good idea, since I have had it be accidentally turned off when rolling around in the bottom of my pannier.  The only downside, is that you have to leave it on charge until you want to start using it, since there is no way to turn it on at the start.

If anyone wants to compare the accuracy of an IgotU and Active 10, I can supply example raw GPX data for the same ride.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 14 December, 2009, 01:47:09 pm
I can't find one quite that cheap at the moment, but I wonder if you could use the GPS units that an increasing number of phones use now.  As long as you can output the data as GPX, and it's got adequate time resolution I don't see why that shouldn't be useful.

Possible, but the battery life on most mobile 'phones isn't great and powering up the GPS chipset will eat even more power. It would also stop me putting my phone in flight mode which I usually do on an Audax to preserve battery life (given that Audaxes often go to lots of places with no mobile reception and mobile 'phones will eat through batteries even quicker when they boost the power in the hope of finding a base station out in the sticks).
Title: Re: Using tracklogs to validate DIY perms
Post by: Ian H on 14 December, 2009, 01:49:36 pm
Step 7: why bother drafting an intended route to submit beforehand? Why not just go for a ride (at the requisite speed), record your track, get home after [230]k, send in the tracklog and claim a 200k DIY? I've been a "long distance cyclist" for the duration of the ride, which what it's all about, no?

The existing rules are built around describing your intentions and then doing the ride. With the current rules, if you pack at 630km into a 1000km ride you get nothing. With the rule proposed above you'd be able to claim for 600km (as long as you were within time). 630km is still a long distance cycle ride, but it's not what you set out to do.

I think that's several steps too far. If you want to just ride your bike, there's the mileater diary. If you want to do an event, there should be formalities to go through.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 14 December, 2009, 01:53:00 pm
Well put, Ian.
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 14 December, 2009, 01:55:01 pm
Possible, but the battery life on most mobile 'phones isn't great and powering up the GPS chipset will eat even more power. ...

Good point.  I imagine they would possibly be logging data at an unnecessarily high a rate.  The IgotU can be configured to take a data point every second, but the battery only lasts 4 hours when running at this rate. At one data point every 30 seconds, it'll last for 30 hours, and any time resolution over 2 minutes is projected to last over 80 hours.

Did Daniel say anything about sampling rate?  (I don't recall anything being said). Obviously you need to be running it fast enough that it's clear that you went through the control, so once every fifteen minutes (mentioned earlier) probably isn't going to be good enough.  In low power mode, my Active 10 samples approximately once every 4 seconds, which is probably higher than needed.  I'd guess that 30 seconds or a minute would be sufficient.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 14 December, 2009, 02:02:31 pm
Did Daniel say anything about sampling rate?  (I don't recall anything being said). Obviously you need to be running it fast enough that it's clear that you went through the control, so once every fifteen minutes (mentioned earlier) probably isn't going to be good enough.  In low power mode, my Active 10 samples approximately once every 4 seconds, which is probably higher than needed.  I'd guess that 30 seconds or a minute would be sufficient.

The sampling rate doesn't have to be fantastic. For AAA calculation, which we hope to build into this, we'd only need a sample every hundred metres. Even for a speed demon, this is only going to be once every six seconds or so.
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 14 December, 2009, 02:12:43 pm
The sampling rate doesn't have to be fantastic. For AAA calculation, which we hope to build into this, we'd only need a sample every hundred metres. Even for a speed demon, this is only going to be once every six seconds or so.

Interesting, that's potentially  slightly more stringent than I expected.  You may need to require threshold percentage of data points, at that spacing, around the control.

GPS can have coverage issues, either due to particularly bad satellite configurations, high cloud cover, tree cover, and others reasons, all of which can occur simultaneously, and could cause poor coverage (and missing data points) for periods.

Stopping for a short while at the control (say a couple of minutes) would probably provide enough points to indicate that the control was definitely visited.

I guess this is the sort of things which will need to be sorted out with testing and a bit of experimentation.
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 14 December, 2009, 02:30:43 pm
Given that, when AUK organisers first set up a few Permanents nearly 30 years ago, sufficient proof of passage was a postcard posted within 5 miles of the control town (following the French requirements which were similar) - I really don't think accuracy is an issue.

NB this worked bacause the first Perms were all linear routes (such as LE-JoG).
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 02:32:36 pm
Given that, when AUK organisers first set up a few Permanents nearly 30 years ago, sufficient proof of passage was a postcard posted within 5 miles of the control town (following the French requirements which were similar) - I really don't think accuracy is an issue.

NB this worked bacause the first Perms were all linear routes (such as LE-JoG).
Sadly things have moved on. DIYs of 199.9km are not being accepted at the moment. A town name isn't sufficient unless we plan routes to be 'way over distance'
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 14 December, 2009, 02:33:06 pm
GPS can have coverage issues, either due to particularly bad satellite configurations, high cloud cover, tree cover, and others reasons, all of which can occur simultaneously, and could cause poor coverage (and missing data points) for periods.

In practice I've only ever had a few rare occurrences of the GPS signal being lost when using it on an Audax. Usually only under heavy tree coverage or vibration turning off the GPS itself. It's quite easy to tell that it hasn't lost the signal because the track is only broken into segments at each of the controls (where I usually turn it off).

I guess this is the sort of things which will need to be sorted out with testing and a bit of experimentation.

I (and many others) can provide GPS tracklogs for most of the Audaxes I've ridden. Most of mine are at an average of 8000 trackpoints per ride (5 or 6 second intervals for a 200, 10 seconds intervals for a 300, etc). Since these contain logs of actual rides with genuine patchy GPS signals etc, they can be used to test the various algorithms/theories. It'd be easier to use these and make up the proposed "control" data rather than the other way round.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 14 December, 2009, 02:43:32 pm
Step 7: why bother drafting an intended route to submit beforehand? Why not just go for a ride (at the requisite speed), record your track, get home after [230]k, send in the tracklog and claim a 200k DIY? I've been a "long distance cyclist" for the duration of the ride, which what it's all about, no?
The existing rules are built around describing your intentions and then doing the ride. With the current rules, if you pack at 630km into a 1000km ride you get nothing. With the rule proposed above you'd be able to claim for 600km (as long as you were within time). 630km is still a long distance cycle ride, but it's not what you set out to do.

I think that's several steps too far. If you want to just ride your bike, there's the mileater diary. If you want to do an event, there should be formalities to go through.
Yes, OK point taken. I'm just playing Devil's Advocate really and trying to think how it might be done if there wasn't a system at all at present, we wanted "to encourage long distance cycling" and we were just concocting a procedure from a clean sheet in order to do simply that.

I wholly accept that if it's felt that the discipline should have an additional element of difficulty above just going out for a ride and then claiming for however far you happen to get, that's fine; we make that a Rule as we have done and call that the baseline. But every extra step or process should have some reason, consciously decided upon, either because we want to make the challenge fundamentally more difficult out of principle, or because it facilitates the administration, or because it answers a problem to which there is no better answer. Not just because it's always been done that way. Why do we need Entry Forms; some naming the day in advance, some just undated? Why do we need a Brevet card?

Please don't anyone get upset - I'm not criticising, just rambling out loud!!! :)
Title: Re: Using tracklogs to validate DIY perms
Post by: Jaded on 14 December, 2009, 02:50:00 pm
I like the discipline of naming your route in advance.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 14 December, 2009, 02:58:09 pm
I like the discipline of naming your route in advance.

It's a requirement of your third-party insurance, as is the application form and the ride date.

The shortest distance rule is to make it easy for organisers, and to ensure consistency. On that matter, no organiser accepts any DIY that is even 100m under distance. That rule comes from the top.
Title: Re: Using tracklogs to validate DIY perms
Post by: Ian H on 14 December, 2009, 03:08:05 pm
...just rambling out loud!!! :)

Janet Street-Porter.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 December, 2009, 03:16:29 pm


The shortest distance rule is to make it easy for organisers, and to ensure consistency. On that matter, no organiser accepts any DIY that is even 100m under distance. That rule comes from the top.
The validation using GPX will really really help with this assuming I could use my postcode as the start and finish. Giving my postcode is more accurate that the name of my town and will fix the 100m problem. Stopping me at present is the fact there is no means of getting a Proof of passage in my street. On the flip side though I;ll probably ride less as I'll be able to stop doing rides that are 'way over distance'.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 14 December, 2009, 03:16:44 pm
Sadly things have moved on. DIYs of 199.9km are not being accepted at the moment. A town name isn't sufficient unless we plan routes to be 'way over distance'

The shortest distance rule is to make it easy for organisers, and to ensure consistency. On that matter, no organiser accepts any DIY that is even 100m under distance. That rule comes from the top.
This is one of the aspects of the present system that I hope Danial's initiative will address. We all know how difficult it can be to have a really nice route ruled out by the fact that there is a highly theoretical shorter alternative if you race up a lunatic-driver-infested dual carriageway for 80k. To have my "nice" route barred because Autoroute can cut off 100m this way is frankly absurd, but I do appreciate that you have to have a subjective cut-off point otherwise where do you decide, so them's the rules and at least it's the same for everyone.

It's a requirement of your third-party insurance, as is the application form and the ride date.
Again, accepted, if the answer is that the insurance is required here to protect the "organiser/organisation". And it's not a lot more hassle to scan in a form and send it with your notice of intended route, so I guess it's a non-point really, except that I'm not clear why the ride date has to be specified for insurance purposes. It might be that this is mentioned in the governing documentation that AUK presumably has somewhere but if so I suspect it's just there because it's just been that way rather than anyone having sat down when the contract was first negotiated and said "we must know the dates on which we are going to be at risk". My car insurance company doesn't ask for this!
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 14 December, 2009, 03:21:15 pm
....  On the flip side though I;ll probably ride less as I'll be able to stop doing rides that are 'way over distance'.
I'm the opposite. I may do less "over-distance" mileage on top of my [200]k but I'll get out on more rides and do more X [200]k rides, so my distance ridden will definitely increase.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 14 December, 2009, 03:22:26 pm
...just rambling out loud!!! :)

Janet Street-Porter.
Ouch! ;D
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 14 December, 2009, 03:27:53 pm
We all know how difficult it can be to have a really nice route ruled out by the fact that there is a highly theoretical shorter alternative if you race up a lunatic-driver-infested dual carriageway for 80k. To have my "nice" route barred because Autoroute can cut off 100m this way is frankly absurd, but I do appreciate that you have to have a subjective cut-off point otherwise where do you decide, so them's the rules and at least it's the same for everyone.
Don't forget there is always some loon prepared to use any A-road on an Audax. Plus some horrendous roads become beautiful at 0300h.

Quote
...
 rather than anyone having sat down when the contract was first negotiated and said "we must know the dates on which we are going to be at risk". My car insurance company doesn't ask for this!
Your car insurance covers you every day of the year.[and they expect you to drive most days]

(not saying you're wrong, just making observations!)
Title: Re: Using tracklogs to validate DIY perms
Post by: simonp on 14 December, 2009, 03:40:44 pm
We all know how difficult it can be to have a really nice route ruled out by the fact that there is a highly theoretical shorter alternative if you race up a lunatic-driver-infested dual carriageway for 80k. To have my "nice" route barred because Autoroute can cut off 100m this way is frankly absurd, but I do appreciate that you have to have a subjective cut-off point otherwise where do you decide, so them's the rules and at least it's the same for everyone.
Don't forget there is always some loon prepared to use any A-road on an Audax. Plus some horrendous roads become beautiful at 0300h.

Quote
...
 rather than anyone having sat down when the contract was first negotiated and said "we must know the dates on which we are going to be at risk". My car insurance company doesn't ask for this!
Your car insurance covers you every day of the year.[and they expect you to drive most days]

(not saying you're wrong, just making observations!)

So does my CTC third party insurance.  They also provide legal assistance for recovering costs from 3rd parties which I don't think the Auk insurance does.

Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 14 December, 2009, 04:31:31 pm
[I'm not clear why the ride date has to be specified for insurance purposes. It might be that this is mentioned in the governing documentation that AUK presumably has somewhere but if so I suspect it's just there because it's just been that way rather than anyone having sat down when the contract was first negotiated and said "we must know the dates on which we are going to be at risk". My car insurance company doesn't ask for this!

AUK insurance is event insurance, not rider insurance.

It starts when you start the 'event', and stops when you stop.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 14 December, 2009, 04:36:02 pm
This is one of the aspects of the present system that I hope Danial's initiative will address. We all know how difficult it can be to have a really nice route ruled out by the fact that there is a highly theoretical shorter alternative if you race up a lunatic-driver-infested dual carriageway for 80k. To have my "nice" route barred because Autoroute can cut off 100m this way is frankly absurd, but I do appreciate that you have to have a subjective cut-off point otherwise where do you decide, so them's the rules and at least it's the same for everyone.

The rule exists to ensure organisers can apply rules consistently, to all entrants, easily.

Your 'under-distance' route is not ‘barred’. You are more than free to ride it, any time you like. However, we won’t validate it.
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 14 December, 2009, 06:13:56 pm
Step 7: why bother drafting an intended route to submit beforehand? Why not just go for a ride (at the requisite speed), record your track, get home after [230]k, send in the tracklog and claim a 200k DIY? I've been a "long distance cyclist" for the duration of the ride, which what it's all about, no?

The existing rules are built around describing your intentions and then doing the ride. With the current rules, if you pack at 630km into a 1000km ride you get nothing. With the rule proposed above you'd be able to claim for 600km (as long as you were within time). 630km is still a long distance cycle ride, but it's not what you set out to do.

I think that's several steps too far. If you want to just ride your bike, there's the mileater diary. If you want to do an event, there should be formalities to go through.

Or if you prefer a more modern approach
Bike Journal (http://yacf.co.uk/forum/index.php?topic=82.0;topicseen)
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 24 February, 2010, 09:01:11 pm
I took the results of the trial to the AUK board meeting today. There was some discussion about the trial, and how we could develop and extend this further. Most importantly though, they agreed this was something we could carry on with.

So, the plan is to roll out DIY validation by GPX in May, after we publish the next Arrivée. Ian H and I are going to offer it, and the other DIY reps will be more than welcome to as well. I suspect not all of them will, and I hope you'll respect their decision if they don't.

The shortest distance rule will still apply.

I'll post a guide nearer the time.

Now, while we wait for that....
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 24 February, 2010, 10:13:02 pm
Good News  :thumbsup:

Thanks Danial.
Title: Re: Using tracklogs to validate DIY perms
Post by: Fidgetbuzz on 24 February, 2010, 10:18:07 pm
Excellent Danial - well done. I will no longer have to do that ride to Tesco and back on the A140 to get an ATM receipt - and can start from home -- now for me that is all good.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 24 February, 2010, 10:24:24 pm
Excellent Danial - well done. I will no longer have to do that ride to Tesco and back on the A140 to get an ATM receipt - and can start from home -- now for me that is all good.
But does that presuppose our area rep will join in the scheme? Or if he doesn't, that Danial, Ian or someone else will validate our rides?
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 24 February, 2010, 11:22:58 pm
But does that presuppose our area rep will join in the scheme? Or if he doesn't, that Danial, Ian or someone else will validate our rides?

I'm sure it'll all work out when it's worked out.
Title: Re: Using tracklogs to validate DIY perms
Post by: Ian H on 24 February, 2010, 11:24:34 pm
I think he means: no one will be disadvantaged.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 25 February, 2010, 12:19:17 am
Well, Thank you Chris. Thank you too FB. You were both a great help in the trial. Rich Forrest, and marcustoo. You all pitched in, and you all took time to write up your rides.  :thumbsup:
Title: Re: Using tracklogs to validate DIY perms
Post by: tonyh on 25 February, 2010, 06:18:15 am

Yet again, serious thanks to the Organisers!
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 25 February, 2010, 06:19:28 am
I think he means: no one will be disadvantaged.

quite
Title: Re: Using tracklogs to validate DIY perms
Post by: Weirdy Biker on 25 February, 2010, 07:59:25 am
I'm going to have to work out how to get tracklogs on my GPS...
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 25 February, 2010, 08:42:13 am
I'm going to have to work out how to get tracklogs on my GPS...
If someone will validated ones from me, I'll have to work out how to get the money together for a GPS and associated software. Once the instructions for 'validation by tracklogs' is available, it would be really great if an savvy user produced a paper entitled 'what you need and how to do DIY by tracklogs'
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 25 February, 2010, 09:54:28 am
I'm going to have to work out how to get tracklogs on my GPS...
If someone will validated ones from me, I'll have to work out how to get the money together for a GPS and associated software. Once the instructions for 'validation by tracklogs' is available, it would be really great if an savvy user produced a paper entitled 'what you need and how to do DIY by tracklogs'

I have one drafted, which will need a spot of editing. That's quite process-oriented though.

FranklyFrankie has written a lot on the technical side of this, so I'll ask him if he'd like to lend his considerable expertise to that side of things.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 25 February, 2010, 10:01:13 am
I'm going to have to work out how to get tracklogs on my GPS...
If someone will validated ones from me, I'll have to work out how to get the money together for a GPS and associated software. Once the instructions for 'validation by tracklogs' is available, it would be really great if an savvy user produced a paper entitled 'what you need and how to do DIY by tracklogs'

I have one drafted, which will need a spot of editing. That's quite process-oriented though.

FranklyFrankie has written a lot on the technical side of this, so I'll ask him if he'd like to lend his considerable expertise to that side of things.
There is lots and lots of information about on using GPS for audaxes. Too much for a novice such as me to digest which is why one paper focused on this will be preferred by me.
Title: Re: Using tracklogs to validate DIY perms
Post by: border-rider on 25 February, 2010, 10:05:52 am
There is lots and lots of information about on using GPS for audaxes. Too much for a novice such as me to digest which is why one paper focused on this will be preferred by me.

absolutely

I've got a GPS that I use occasionally, but not often enough to be inclined to follow all the available info on the subject.

A guide for the less-than-GPS-focussed would be good


and: great work, Danial.  This will make things much easier; I really struggle to get a start control near where I live, and the one I can use is time-restricted.
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 25 February, 2010, 11:13:56 am
There is tendency for most information out there to be focused on the bestest latest gadgets. This won't be helpful for the impecunious, non-techie AUK.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 25 February, 2010, 11:21:09 am
There is tendency for most information out there to be focused on the bestest latest gadgets. This won't be helpful for the impecunious, non-techie AUK.
The paper needs to be general enough to be useful for different models of device. I'd write one if I knew what the process was. I'm not a professional writer but quite good at How To Guides.
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 25 February, 2010, 11:26:03 am
Trouble is, GPS units vary widely in how they operate.

Sure, there are some general guidelines (Always start with an empty tracklog, When on a very long ride, save your tracklog to card if you have one to avoid tracklog wrapping and truncation... etc etc) but the ways in which you achieve these will vary with each type of unit.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 25 February, 2010, 11:30:40 am
Trouble is, GPS units vary widely in how they operate.

Sure, there are some general guidelines (Always start with an empty tracklog, When on a very long ride, save your tracklog to card if you have one to avoid tracklog wrapping and truncation... etc etc) but the ways in which you achieve these will vary with each type of unit.

But with a bit of work you can cover off 80% of the common GPS models.

I'll write a guide for the bog standard yellow eTrex (the one with no memory card and no mapping).

jwo can adapt it for the Geko since he's used to using them on an Audax.

You can write one for the HCx Vista/Legend/Venture models that are all pretty similar and you're used to them.

Someone else can do an Edge 305.

Someone else an Edge 605/705 (if they're vastly different).

[EDIT] As an aside. An eTrex H can be found for about £65. Handlebar mount for £10. A cable for £15 delivered from eBay. The software I use to do it all is free. So that's £90 (or cheaper if you find a good deal on eBay). That (with a bit more work) will also allow provide navigation functionality on an Audax if you take the time to plot the route on one of various free websites, download it, massage the data slightly and then upload it to the GPS. This is exactly the setup I use on Audaxes (including LEL).
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 25 February, 2010, 11:42:57 am
But with a bit of work you can cover off 80% of the common GPS models.

True enough - and I'm happy to contribute.
Title: Re: Using tracklogs to validate DIY perms
Post by: TOBY on 25 February, 2010, 11:44:16 am
Trouble is, GPS units vary widely in how they operate.

Sure, there are some general guidelines (Always start with an empty tracklog, When on a very long ride, save your tracklog to card if you have one to avoid tracklog wrapping and truncation... etc etc) but the ways in which you achieve these will vary with each type of unit.

But with a bit of work you can cover off 80% of the common GPS models.

I'll write a guide for the bog standard yellow eTrex (the one with no memory card and no mapping).

jwo can adapt it for the Geko since he's used to using them on an Audax.

You can write one for the HCx Vista/Legend/Venture models that are all pretty similar and you're used to them.

Someone else can do an Edge 305.

Someone else an Edge 605/705 (if they're vastly different).

[EDIT] As an aside. An eTrex H can be found for about £65. Handlebar mount for £10. A cable for £15 delivered from eBay. The software I use to do it all is free. So that's £90 (or cheaper if you find a good deal on eBay). That (with a bit more work) will also allow provide navigation functionality on an Audax if you take the time to plot the route on one of various free websites, download it, massage the data slightly and then upload it to the GPS. This is exactly the setup I use on Audaxes (including LEL).

am I the only person who got an instruction manual with their GPS?  ;)
Title: Re: Using tracklogs to validate DIY perms
Post by: Manotea on 25 February, 2010, 11:45:54 am
Trouble is, GPS units vary widely in how they operate.

Sure, there are some general guidelines (Always start with an empty tracklog, When on a very long ride, save your tracklog to card if you have one to avoid tracklog wrapping and truncation... etc etc) but the ways in which you achieve these will vary with each type of unit.

But with a bit of work you can cover off 80% of the common GPS models.

I'll write a guide for the bog standard yellow eTrex (the one with no memory card and no mapping).

jwo can adapt it for the Geko since he's used to using them on an Audax.

You can write one for the HCx Vista/Legend/Venture models that are all pretty similar and you're used to them.

Someone else can do an Edge 305.

Someone else an Edge 605/705 (if they're vastly different).

[EDIT] As an aside. An eTrex H can be found for about £65. Handlebar mount for £10. A cable for £15 delivered from eBay. The software I use to do it all is free. So that's £90 (or cheaper if you find a good deal on eBay). That (with a bit more work) will also allow provide navigation functionality on an Audax if you take the time to plot the route on one of various free websites, download it, massage the data slightly and then upload it to the GPS. This is exactly the setup I use on Audaxes (including LEL).

am I the only person who got an instruction manual with their GPS?  ;)

I cannot see what the fuss is about. It only took me a year or so to get to grips with my Vista.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 25 February, 2010, 11:51:09 am
I am sure I can   get a device to        record a track, but it's the linking it with the DIY entry so my track goes through the places I said it would. Some of these places will be postcodes and unnamed places at a junction. At least that's my understanding of the benefits of such a scheme.

If people have already done this, why not share the knowledge ?
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 25 February, 2010, 11:57:19 am
If Danial's happy with me making public my tracklogs and route from my tests, I'm happy to do that and write something up. It'll be Vista-centric, but application to other units can be an exercise for the student...

Danial?
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 25 February, 2010, 11:57:57 am
I am sure I can   get a device to        record a track, but it's the linking it with the DIY entry so my track goes through the places I said it would. Some of these places will be postcodes and unnamed places at a junction. At least that's my understanding of the benefits of such a scheme.

Yes, as I understand it, you submit a DIY entry as you would now but you use the GPX tracklog as proof of passage for some of the controls that you knew you wouldn't be able to get proof-of-passage at.

In other words, if you can make ViaMichelin or Autoroute use a specific point as a waypoint on your route for distance validation purposes then the corresponding GPX tracklog will be your proof that you went to through/past/very-close-to that point.
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 25 February, 2010, 12:26:18 pm
GPS jammer plugs into cigarette lighter Boing Boing (http://boingboing.net/2009/07/30/gps-jammer-plugs-int.html)
Title: Re: Using tracklogs to validate DIY perms
Post by: red marley on 25 February, 2010, 12:30:44 pm
See also:

howToUseAPrinterToPrintFakeReceiptsAndATMSlips.com

and

howToUseAChildsPrintingKitToFakeAStamp.com

and

howToFakeAControlerSignature.co.uk
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 25 February, 2010, 12:34:43 pm
You forgot:-

howToMakeTwoPurchasesAtEachDIYControlToProvideBrevidenceForAFriend.org
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 25 February, 2010, 12:35:11 pm
I find this one useful:
viamichelin.com/routeplanner/add_20k.diy
Title: Re: Using tracklogs to validate DIY perms
Post by: border-rider on 25 February, 2010, 12:43:59 pm
HowToRideAPermOnnaMoped.com/managing_long_cafe_stops.pdf
Title: Re: Using tracklogs to validate DIY perms
Post by: Manotea on 25 February, 2010, 12:46:02 pm
or for a more lo-tek solution (http://cgi.ebay.co.uk/Samsung-ER-100-Electronic-Cash-Register-Shop-Till_W0QQitemZ220560525162QQcmdZViewItemQQptZLH_DefaultDomain_3?hash=item335a6e876a)
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 25 February, 2010, 12:47:00 pm
No Mal that one won't work - not with gpx validation.

I am sure I can   get a device to        record a track, but it's the linking it with the DIY entry so my track goes through the places I said it would.

Hmm.  A tracklog goes where it goes, end of.

So as I see it, all you need to do is
1. Clear the 'current' or 'active' track in the GPS immediately before you start your ride.
2. Carry spare batteries in case of need.
3. Switch the GPS off at the end of your ride, to put a break in the track.
4. Extract the 'current' or 'active' track from the GPS and save to disk in GPX form, as soon as possible after the end of your ride.  Just submit this gpx.

For rides longer than 400km you may need to take  more precautions, but those are relatively rare.

Danial's software (I should say Peter C's, he wrote it) or the prototype version I've had sight of, can display the track on a map to give a quick visual route check, and more usefully can also display it in summary form (distance, start and finish times, max/min/average speeds, total climb) which is a very quick way to check it's valid, the software can also do more detailed analysis (speed vs gradient) if needed but usually it wouldn't be.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 25 February, 2010, 01:40:50 pm
Wow! All good stuff! Keep it coming!

If it's OK with those who have offered to help, I'll be in touch as and when I'll need help with my process redraft. We have until May, so no huge rush.

I don't see it as AUK's role to show people how to use their GPS units. As Chris S points out, GPS units differ widely in their buttons and menus, but work in similar ways. What we can do is outline the concept of how they work, how that allows you track your ride, and what you need to do to have that ride validated as a DIY perm.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 25 February, 2010, 05:14:50 pm
No Mal that one won't work - not with gpx validation.

I am sure I can   get a device to        record a track, but it's the linking it with the DIY entry so my track goes through the places I said it would.

Hmm.  A tracklog goes where it goes, end of.

So as I see it, all you need to do is
1. Clear the 'current' or 'active' track in the GPS immediately before you start your ride.
2. Carry spare batteries in case of need.
3. Switch the GPS off at the end of your ride, to put a break in the track.
4. Extract the 'current' or 'active' track from the GPS and save to disk in GPX form, as soon as possible after the end of your ride.  Just submit this gpx.

For rides longer than 400km you may need to take  more precautions, but those are relatively rare.

Danial's software (I should say Peter C's, he wrote it) or the prototype version I've had sight of, can display the track on a map to give a quick visual route check, and more usefully can also display it in summary form (distance, start and finish times, max/min/average speeds, total climb) which is a very quick way to check it's valid, the software can also do more detailed analysis (speed vs gradient) if needed but usually it wouldn't be.

That's great, thanks.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 25 February, 2010, 05:16:13 pm
Wow! All good stuff! Keep it coming!

If it's OK with those who have offered to help, I'll be in touch as and when I'll need help with my process redraft. We have until May, so no huge rush.

I don't see it as AUK's role to show people how to use their GPS units. As Chris S points out, GPS units differ widely in their buttons and menus, but work in similar ways. What we can do is outline the concept of how they work, how that allows you track your ride, and what you need to do to have that ride validated as a DIY perm.
But saying 'you can now submit a GPX track to validate a DIYPerm' is surely not all you want us to do ? I eagerly await the documents that you are prepared to produce to tell us how to do this.
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 25 February, 2010, 05:42:09 pm
Quote
So as I see it, all you need to do is
1. Clear the 'current' or 'active' track ...
etc

Also two set-and-forget things to do with the GPS.

i) go into the menus and and raise the Track Points figure to the max, which is usually 10000
finding this menu option will vary with model, in the Etrex C its in a completely illogical place, under Map Setup page 2
(http://www.aukadia.net/gps/setup13b.gif)
and for some reason by default the figure is set much lower.

ii) if your GPS is of the type that has a flash card for storage, go into the menus and enable Log Track to Data Card (assuming there is some space on the card of course).  This will ensure that if you undertake any really long rides 400 and over, no track data will be lost.
Again in the Etrex Cx, by default this feature is not enabled. (In the Oregon/Dakota, it is.)
Title: Re: Using tracklogs to validate DIY perms
Post by: Weirdy Biker on 25 February, 2010, 06:15:37 pm
As a slight aside, does this mean that John Ward/the committee will be comfortable accepting GPS tracklogs more generally for non-DIY permanents.

I'm thinking in particular of the E2E I organise, where accepting tracklogs will potentially make my accepting and checking submitted routes and reconcilling these with completed brevets more flexible (a problem on long rides like LEJOG, particularly given LE and JOG can be difficult to find controls in outside of working hours).
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 25 February, 2010, 06:27:42 pm
There's a bigger issue; are we going to create:

 Yet Another Cycling Forum
|-+  General Category
| |-+  Audax and Cyclosportive
| | |-+  GPS

or

 Yet Another Cycling Forum
|-+  Geek Knowledge
| |-+  GPS
| | |-+  Audax and Cyclosportive

?
Title: Re: Using tracklogs to validate DIY perms
Post by: marcus on 25 February, 2010, 08:34:36 pm
Bit late to this but can I add my thanks to Danial for running the trial and taking the results to the AUK committee. I contributed several rides to the trial and it really is remarkably easy. You don't need to be a GPS whiz. I'm looking forward to it being rolled out in May.
Title: Re: Using tracklogs to validate DIY perms
Post by: JayP on 25 February, 2010, 09:03:47 pm
Bit late to this but can I add my thanks to Danial for running the trial and taking the results to the AUK committee. I contributed several rides to the trial and it really is remarkably easy. You don't need to be a GPS whiz. I'm looking forward to it being rolled out in May.


+1  Spot on!
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 25 February, 2010, 09:10:16 pm
Cheers marcus! And thank you for making such a big contribution to the trial. Along with RichForrest's rides, your submissions showed really quickly just how easy the process can be.

What's been good for me is that this has reinvigorated my enthusiasm for DIY perms. I'd started to get bored of looking at atm receipts. The analysis software that Pete has developed shows a lot more about the ride than a brevet card can. You can see when people stop, and how long for, with profiles for speed and altitude. We can also see the file on a google map. It makes it a lot more interesting to do.
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 25 February, 2010, 09:50:28 pm
You can see when people stop, and how long for, with profiles for speed and altitude. We can also see the file on a google map. It makes it a lot more interesting to do.

<fboab>
And when they pack at 194km
</fboab>

Dammit, I'm in trouble now...  :-\
Title: Re: Using tracklogs to validate DIY perms
Post by: dehomag on 25 February, 2010, 09:51:54 pm
You can see when people stop, and how long for, with profiles for speed and altitude. We can also see the file on a google map. It makes it a lot more interesting to do.

<fboab>
And when they pack at 194km
</fboab>

Dammit, I'm in trouble now...  :-\

Whenever I pack I don't submit my card. Just a waste of time for me and the organiser
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 25 February, 2010, 09:53:52 pm
Whenever I pack I don't submit my card. Just a waste of time for me and the organiser

Ahh... well, these were slightly unusual circumstances :)
Title: Re: Using tracklogs to validate DIY perms
Post by: Fidgetbuzz on 25 February, 2010, 10:32:11 pm
You can see when people stop, and how long for, with profiles for speed and altitude. We can also see the file on a google map. It makes it a lot more interesting to do.

<fboab>
And when they pack at 194km
</fboab>

Dammit, I'm in trouble now...  :-\

Yebbut - tracklogs dont show the bruises - or the kind people who rescued fboab - so they dont tell all the tale - we shall still need ride reports!!
Title: Re: Using tracklogs to validate DIY perms
Post by: Ian H on 25 February, 2010, 10:35:06 pm
Anyone who wishes to do a DIY has to sign, with witnesses, a four page document certifying that he/she is honest and of good character.
Title: Re: Using tracklogs to validate DIY perms
Post by: L CC on 26 February, 2010, 01:32:51 pm
You can see when people stop, and how long for, with profiles for speed and altitude. We can also see the file on a google map. It makes it a lot more interesting to do.

<fboab>
And when they pack at 194km
</fboab>

Dammit, I'm in trouble now...  :-\
194km=
(http://i952.photobucket.com/albums/ae7/fboab/pram.jpg)

You had to be there...

Back on topic... tracklogs will be good. I would probably (there's always a risk of incompetence, after all) been able to get my french adventures validated and no longer will Danial be able to see in black & white just how extensive my Double Decker habit can be...
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 26 February, 2010, 04:02:13 pm
**grin**
Title: Re: Using tracklogs to validate DIY perms
Post by: saturn on 13 May, 2010, 01:57:16 pm
Details now announced in Arrivee - congrat's to Danial and others who have made this come about.

One thing I'm not sure about - is there a limit on the number of checkpoints? In order to minimise how far over-distance the desired route is one could simply add more and more checkpoints so that the shortest route becomes very close to the desired route. But how many would be too many, say on a 200?

Also, what's the preferred way of identifying a checkpoint? Lat/Long, OS coord's, text description, or does it depend on the DIY Perm organiser?
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 13 May, 2010, 09:22:45 pm
One thing I'm not sure about - is there a limit on the number of checkpoints?

Not really. Just don't take the mickey. If I got 20 checkpoints for a 200km without good reason, or regularly, I'd probably decline to validate.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 13 May, 2010, 09:31:20 pm
Also, what's the preferred way of identifying a checkpoint? Lat/Long, OS coord's, text description, or does it depend on the DIY Perm organiser?

Personally, I don't have one. One prospective triallist went to great lengths to put lots of controls in very specific, hard to check spots, to shave kms. It becomes an ordeal when people hog your time like that, and you do wonder why someone would spend an hour in front of their PC to save thirty minutes of cycling.

If I'm brutally honest, when I receive entries like that, I generally dawdle over the reply and stop being helpful. Much rather have someone like marcus or JayP. They bang out the routes; town and village centres, control every 50km (often much less for JayP), 215km for 200km validation without question.
Title: Re: Using tracklogs to validate DIY perms
Post by: saturn on 14 May, 2010, 08:19:50 am
For me it arises from a combination of wanting to ride exclusively quiet lanes and 200km being about the limit of my ability. I was up to about 10 checkpoints plus the start/finish and I thought that might be burdensome to validate - it would be the equivalent of about 7 info controls on a 200 calendar event which I think would be unusual.

Village centres makes good sense.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 14 May, 2010, 08:40:39 am
For me it arises from a combination of wanting to ride exclusively quiet lanes and 200km being about the limit of my ability. I was up to about 10 checkpoints plus the start/finish and I thought that might be burdensome to validate - it would be the equivalent of about 7 info controls on a 200 calendar event which I think would be unusual.

Village centres makes good sense.
It depends on the nature of the route. I have a 200 out and back which is actually about 16 km ovr distance, only needs 5 controls. The most direct route is the one I would want to ride and the auto routing algorithms generate the same thing. It's as flat as a pancake and the turn around place is a cafe so I would want to go there. The first and last control (not start and finish) are needed to avoid it routing me up the A1 which is motorway in all but name (the A1(M) changes into the A1 without any real change in the road). This is where the tracklogs is invaluable, it allows controls to be added in places where no physical control can be had so I can ride the route I want without having to go well over distance to make up for the un ridable and on distance but shorter direct route.

I also have a hilly 200 for which I want to get AAA points which has not yet been submitted for approval that needs 10 controls including start and finish. It needs these to persuade the auto routing algorithms to calculate the min distance by avoiding the main roads and to route me over the hills.  It's not an out and back and not a big loop, there are lots of roads in the vicinity so short cuts or faster routes are certainly possible without some of the intermediates.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 14 May, 2010, 09:13:55 am
10-12 controls for a 200 is fine. That's not unusual for DIYs at the moment. Where it becomes trying is when come back again and again with refinements.

If you struggle to ride 200km, and 210km is too much, then perhaps you're not ready for a 200km DIY yet. You could always ride an event instead, or perhaps try out some slightly shorter rides validated at 150km.
Title: Re: Using tracklogs to validate DIY perms
Post by: saturn on 14 May, 2010, 09:54:34 am
OK that's great thanks.

It was something like 220km with 8 dropping to 210km with 10 and 205km with 11 or 12. I can do 200km fairly comfortably but wouldn't want to go too much farther, more because it would start to become less enjoyable than physically impossible. Plus 220km on twisty narrow lanes maybe equates to 250km or more on B roads in terms of time as well as perhaps effort.

I can see that it becomes even trickier if you need to include specific hills.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 14 May, 2010, 10:08:14 am
and you do wonder why someone would spend an hour in front of their PC to save thirty minutes of cycling.

I don't get paid for my cycling time...
Title: Re: Using tracklogs to validate DIY perms
Post by: dasmoth on 16 May, 2010, 11:15:42 am
If two people are riding a DIY together, would a single tracklog (submitted separately by each rider) be acceptable?  Or does every rider need his own GPS unit?

Would riding a tandem (which is the scenario I have in mind -- we probably could find and mount a suitable secondary GPS, but it seems like a slightly odd thing to be doing!) make a difference?
Title: Re: Using tracklogs to validate DIY perms
Post by: Paul D on 16 May, 2010, 11:34:17 am
If two people are riding a DIY together, would a single tracklog (submitted separately by each rider) be acceptable?  Or does every rider need his own GPS unit?

Would riding a tandem (which is the scenario I have in mind -- we probably could find and mount a suitable secondary GPS, but it seems like a slightly odd thing to be doing!) make a difference?

Four of us came a cropper on this after the Arrow. Only one ended up with the gpx-validated AAA points as only one of us could provide a full gpx file. Unfortunately one Etrex run out of battery life at about 180k of our 200 and we never thought of the consequences of not changing the batteries duh!

Not sure about the tandem question though.
Title: Re: Using tracklogs to validate DIY perms
Post by: dasmoth on 16 May, 2010, 11:43:10 am
Okay, that's sounding like a case of nGPS+1 then.  I suppose it makes sense.
Title: Re: Using tracklogs to validate DIY perms
Post by: Ivo on 17 May, 2010, 09:55:25 pm
One thing I'm not sure about - is there a limit on the number of checkpoints?

Not really. Just don't take the mickey. If I got 20 checkpoints for a 200km without good reason, or regularly, I'd probably decline to validate.

Jumping in the thread quite late, a lot of checkpoints could be needed if you for example want to do a pro-classic as a DIY. They hardly have a straight-line route so you'd probably need several 'checkpoints' on top of nasty hills in the middle of nowhere.
I might be tempted to try to make a decent GPS track for a few of the spring classics in my area. Doing them as paper-based permanents would be next-to-impossible, as a GPS-DIY it should be quite doable. Are there any ideas yet of a database with tracks of allready ridden and validadated DIY's? That would be an interesting addition to the permanents.
Title: Re: Using tracklogs to validate DIY perms
Post by: saturn on 16 June, 2010, 10:07:10 pm
I'm going to have a go at one of these. The Arrivee article says "turn GPS on at start, switch it off at finish". Normally I also turn mine off during cafe/pub stops to save the battery and avoid unwanted tracks around cafes and to the gents. I then join the tracks with Mapsource.

Is this acceptable or does it have to be a complete unadulterated track? Thinking about it, it must be permissible to join tracks in case batteries have to be changed - yes?
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 16 June, 2010, 10:09:51 pm
Is this acceptable or does it have to be a complete unadulterated track? Thinking about it, it must be permissible to join tracks in case batteries have to be changed - yes?

Yes. It's fine.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 16 June, 2010, 10:23:49 pm
It is. But, if you end up with, say, four tracks, I'd prefer to receive four tracks than something that someone you've joined together.

But why not just leave it on? Even if it's in your pocket, it'll keep ticking over even if it has no satellite locks. That way, you keep a single track and it'll start tracking quicker once you set off again.
Title: Re: Using tracklogs to validate DIY perms
Post by: saturn on 16 June, 2010, 10:54:04 pm
It is. But, if you end up with, say, four tracks, I'd prefer to receive four tracks than something that someone you've joined together.

But why not just leave it on? Even if it's in your pocket, it'll keep ticking over even if it has no satellite locks. That way, you keep a single track and it'll start tracking quicker once you set off again.

OK separate tracks it is. I've always done it just to save the battery but battery life doesn't seem to be an issue. Start-up appears to be pretty instant after a typical length cafe stop. In this context I thought it might be better to keep the track tidy - just the cycling bit.
Title: Re: Using tracklogs to validate DIY perms
Post by: Ivo on 17 June, 2010, 10:21:28 am
Depending on the pub you visit the track can turn quite messy. During my 400 last month I stayed maybe 20 minutes in a pub just next to the Namur citadel, but at river level. The GPS hardly received a signal there (quite logical with a 200m high rock directly next to it) and was all over the place, completely messing up the distance reading. Besides, for a longer DIY I certainly would be at the edge of the memory capacity of my Vista. abt. 800km is the max even if I turn it off at each stop.
Title: Re: Using tracklogs to validate DIY perms
Post by: Weirdy Biker on 17 June, 2010, 11:33:00 am
My understanding.

For longer rides, you can set a different sample rate (either based on time between samples or distance).

In any case, as I understand it, the important thing is not that the organisers receive tracklogs for the whole route, only "timestamps" at the locations you tell them in advance will be controls.  The track between them is irrelevant for validation (provided you don't intend to claim for AAA points).

In other words, in theory, a gps track log could just have a record of being in the control towns (as the file will show location and time, the two vital bits of info for validation).
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris N on 17 June, 2010, 11:54:53 am
For longer rides, you can set a different sample rate (either based on time between samples or distance).

Yep.  For our 1300 round Scotland, we each used different sampling rates.  Toby had 1 point every 5 seconds (!), Paul used the default on his unit (whatever that was) and I had to squeeze it all into the 10,000 point limit on my Etrex H - so I set the intervals to 140m.  This was only just about good enough for the AAA man, though 100m intervals (or shorter) would have been better.
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 17 June, 2010, 12:00:17 pm
If you used something like a Satmap Active 10, I think the slowest rate you can use is one sample every 4 seconds!  It doesn't seem to care how long the route gets, and the internal storage can certainly store days of data (probably months!) before it runs out.

I suspect using something like an IgotU tracker, set with a 30 second interval, you'd be limited by the internal battery life rather than the storage size, which I think for that unit is 32768 sample points (and which would be over ten days at a 30 second sampling rate).
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 17 June, 2010, 12:11:06 pm
With a 30 second resolution, and doing around 12 mph, you'd only get samples at 160m spacing.  I suppose if you wanted to be OK with controls, you just need to stop for a minute or two, and use the time to grab a loo break, or partake of some munchies, to ensure that your presence at that point was clearly shown.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 17 June, 2010, 12:14:34 pm
I point every second with the Edge 705. It's useful to have a 1GB internal memory (with a separate card for the maps).

My recent (slow) 400 gave me a 35MB TCX file (with cadence, HR and power too) so the 1GB would be good for over 10000km.

:)
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 17 June, 2010, 01:10:36 pm
If you used something like a Satmap Active 10, I think the slowest rate you can use is one sample every 4 seconds!  It doesn't seem to care how long the route gets, and the internal storage can certainly store days of data (probably months!) before it runs out.
Care here - I haven't tested it recently, with the latest firmware release, but previously my Satmap ran out of track after about 240km, even using the "coarse" recording option. A particular pain as I was doing a 300km DIY. Had I been trying to validate it by GPS, I'd have been well annoyed, since there was no visible way of knowing it had given up the ghost since the Trip Log (but not the recorded track) was still accruing.
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 17 June, 2010, 01:23:16 pm
Hmm, interesting.  I'll have to check mine.  It's been sat plugged in for the last several days, and generally when left like that, the screen is one huge red blob from the static "fix".  I obviously don't normally keep that data, but it would be interesting to see if it stopped recording info at some point.

The longest recording I have is only about 215km, so not quite at the limit you mentioned.
Title: Re: Using tracklogs to validate DIY perms
Post by: Ivo on 17 June, 2010, 02:12:33 pm
It might very well be possible that the various makes have a different maximum memory. I've set my Vist Hcx at the lowest level (via the tracks option in the menu) so now I can log abt. 800km while before a 600 would allready be a problem. Knowing the habits of the Vista I expect there's a hidden function somewhere which could boost the performance to abt. 1200km. If someone has the golden tip towards that, it would be nice to know before the start of tomorrows 1200 ;).
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 17 June, 2010, 03:55:55 pm
Assuming the number of points recorded has been set to its maximum of 10,000 (not the factory default of about 3000) - a Vista HCx set at 'auto' and 'normal' would, I estimate, safely record 500km at cycling speeds but probably not quite 600.  But you can set it right up to to 'most' and still record everything on a 600 1200 (by enabling 'log track to data card' - highly recommended) but the resultant track will be split into several (at each midnight) so you'd need to re-join them before submission for validation.

I set the intervals to 140m.  This was only just about good enough for the AAA man, though 100m intervals (or shorter) would have been better.

In theory I suppose an interval of about 100m would be quite good for this purpose, as it should prevent a lot of the apparent 'wandering' when stopped under a garage canopy.  Large spikes would still occasionally happen, but commoner smaller ones shouldn't get written.  It would also of course fit comfortably within the 10,000 limit for the Active Log, for a 600km.

Quote from: Frere Yacker
In other words, in theory, a gps track log could just have a record of being in the control towns (as the file will show location and time, the two vital bits of info for validation).

The validator needs to see indications that the file was generated by cycling - so the track log between the controls is needed (though any gaps due to battery failure etc needn't be a problem).
Title: Re: Using tracklogs to validate DIY perms
Post by: Weirdy Biker on 17 June, 2010, 05:44:44 pm
The validator needs to see indications that the file was generated by cycling - so the track log between the controls is needed (though any gaps due to battery failure etc needn't be a problem).

This is a stronger burden of proof than non-GPS forms of control.  After all, an ATM receipt doesn't tell whether I cycled, walked or drove to the town.  Still, if those are the rules...
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 17 June, 2010, 05:57:14 pm
The validator needs to see indications that the file was generated by cycling - so the track log between the controls is needed (though any gaps due to battery failure etc needn't be a problem).
This is a stronger burden of proof than non-GPS forms of control.  After all, an ATM receipt doesn't tell whether I cycled, walked or drove to the town.  Still, if those are the rules...

The 'rules' don't admit to an ATM receipt being acceptable.  The 'rules' demand a time, stamp and signature on your brevet card.

ATM receipts are very unsatisfactory and tracklogs offer an opportunity to do something better.
Title: Re: Using tracklogs to validate DIY perms
Post by: dkahn400 on 17 June, 2010, 06:00:51 pm
The validator needs to see indications that the file was generated by cycling - so the track log between the controls is needed (though any gaps due to battery failure etc needn't be a problem).

This is a stronger burden of proof than non-GPS forms of control.  After all, an ATM receipt doesn't tell whether I cycled, walked or drove to the town.  Still, if those are the rules...

No it isn't, it's weaker. A till receipt is physical evidence that someone went somewhere to get it printed off at a certain time and date. A gpx file with one point per control is nothing more than proof that someone produced a gpx file. You can do this sitting at your computer. I have queried elsewhere whether even a full track is really evidence but at least it can be audited to see if it looks like a typical cycling track. Effective cheating would have to be fairly sophisticated.
Title: Re: Using tracklogs to validate DIY perms
Post by: Jaded on 17 June, 2010, 06:08:03 pm
A till receipt is physical evidence that someone went somewhere to get it printed off at a certain time and date.

Yes, but not necessarily the time and date the cyclist was there. When I did my first DIY last year I was explaining to one shop keeper what I needed ( the location of the store on the receipt) and he just gave me one that was lying on the counter. It was a good 40 minutes before the time I was in the shop.  I said no, I needed one now, if that was OK.
Title: Re: Using tracklogs to validate DIY perms
Post by: TOBY on 17 June, 2010, 06:23:44 pm
The validator needs to see indications that the file was generated by cycling - so the track log between the controls is needed (though any gaps due to battery failure etc needn't be a problem).

This is a stronger burden of proof than non-GPS forms of control.  After all, an ATM receipt doesn't tell whether I cycled, walked or drove to the town.  Still, if those are the rules...

No it isn't, it's weaker. A till receipt is physical evidence that someone went somewhere to get it printed off at a certain time and date. A gpx file with one point per control is nothing more than proof that someone produced a gpx file. You can do this sitting at your computer. I have queried elsewhere whether even a full track is really evidence but at least it can be audited to see if it looks like a typical cycling track. Effective cheating would have to be fairly sophisticated.


1. open one of my old tracklogs from a previous ride, say a 600km from 2009-09-15

2. <Find and Replace> 2009-09-15 <replace with> date of my choice <enter>

3. BINGO!
Title: Re: Using tracklogs to validate DIY perms
Post by: dkahn400 on 17 June, 2010, 06:26:34 pm
A till receipt is physical evidence that someone went somewhere to get it printed off at a certain time and date.

Yes, but not necessarily the time and date the cyclist was there. When I did my first DIY last year I was explaining to one shop keeper what I needed ( the location of the store on the receipt) and he just gave me one that was lying on the counter. It was a good 40 minutes before the time I was in the shop.  I said no, I needed one now, if that was OK.

And of course the date and/or time in the till may be wrong, or it may show a completely different location from the actual one.

Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 17 June, 2010, 06:28:38 pm
The validator needs to see indications that the file was generated by cycling - so the track log between the controls is needed (though any gaps due to battery failure etc needn't be a problem).

This is a stronger burden of proof than non-GPS forms of control.  After all, an ATM receipt doesn't tell whether I cycled, walked or drove to the town.  Still, if those are the rules...

No it isn't, it's weaker. A till receipt is physical evidence that someone went somewhere to get it printed off at a certain time and date. A gpx file with one point per control is nothing more than proof that someone produced a gpx file. You can do this sitting at your computer. I have queried elsewhere whether even a full track is really evidence but at least it can be audited to see if it looks like a typical cycling track. Effective cheating would have to be fairly sophisticated.


1. open one of my old tracklogs from a previous ride, say a 600km from 2009-09-15

2. <Find and Replace> 2009-09-15 <replace with> date of my choice <enter>

3. BINGO!

that's a good idea

%s/2009-09-15/2010-06-17/g
ZZ
Title: Re: Using tracklogs to validate DIY perms
Post by: Jaded on 17 June, 2010, 06:32:44 pm
Maybe what should be required is a combination of all of these:

A GPS track
Cash point receipts, backed up with a copy of bank statement
Till receipts
Signatures from authorised people, such as Doctors, Solicitors etc?

That should cut out most cheating.
 ;D ;D
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 17 June, 2010, 06:37:28 pm
I have to say I'm surprised the GPS validation doesn't require, say, 1 piece of "paper" brevidence so that you at least have to leave the room your computer is in.

(Of course this knackers the paper-free option, so that may be the rationale.)
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 17 June, 2010, 06:39:21 pm
I think we should eschew this Validation by GPS malarkey since it's too easy to forge. I am sure I read in these very pages a few months ago that the logs are difficult to forge. ;)
Title: Re: Using tracklogs to validate DIY perms
Post by: dkahn400 on 17 June, 2010, 06:41:28 pm
The validator needs to see indications that the file was generated by cycling - so the track log between the controls is needed (though any gaps due to battery failure etc needn't be a problem).

This is a stronger burden of proof than non-GPS forms of control.  After all, an ATM receipt doesn't tell whether I cycled, walked or drove to the town.  Still, if those are the rules...

No it isn't, it's weaker. A till receipt is physical evidence that someone went somewhere to get it printed off at a certain time and date. A gpx file with one point per control is nothing more than proof that someone produced a gpx file. You can do this sitting at your computer. I have queried elsewhere whether even a full track is really evidence but at least it can be audited to see if it looks like a typical cycling track. Effective cheating would have to be fairly sophisticated.


1. open one of my old tracklogs from a previous ride, say a 600km from 2009-09-15

2. <Find and Replace> 2009-09-15 <replace with> date of my choice <enter>

3. BINGO!

I already pointed out on the Yahoo group that the date is extremely easy to forge if one already has a genuine tracklog. I understand that submitted track logs will be analysed by a computer programme which would catch anomalies in a log produced completely artificially. That should be good enough unless someone is determined enough to write a program to forge logs. Such a program would need to take account of position error variation, occasional loss of signal, rest and comfort stops, the odd mechanical, variation in a rider's form, gradient, and wind speed and direction thoughout the ride. Producing such a program would be a challenge but once it exists anyone could churn out convincing gpx files at will. That's the main concern I have with validation by gpx.
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 17 June, 2010, 06:46:26 pm
SOunds like a challenge. A program to examine some genuine logs to determine a particular riders and devices 'characteristics' then synthesise a log using those characteristics.
Title: Re: Using tracklogs to validate DIY perms
Post by: dkahn400 on 17 June, 2010, 06:51:00 pm
SOunds like a challenge. A program to examine some genuine logs to determine a particular riders and devices 'characteristics' then synthesise a log using those characteristics.

The problem is someone might just be nerdy enough to write the software just for the challenge without any specific intention of actually using it. Then they would have to share it around a bit for the kudos. Then it's in the wild.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 17 June, 2010, 07:03:22 pm

1. open one of my old tracklogs from a previous ride, say a 600km from 2009-09-15

2. <Find and Replace> 2009-09-15 <replace with> date of my choice <enter>

3. BINGO!

This is the biggest flaw in DIY by GPS. It is incredibly easy to change the ride date. However, you do actually have to ride the ride. I'm aware that it's easy to pass gpx files around, and to change the date, which is why we're looking out for exactly that sort of tomfoolery. It's as easy to spot as it is to forge.

Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 17 June, 2010, 07:07:23 pm

The problem is someone might just be nerdy enough to write the software just for the challenge without any specific intention of actually using it. Then they would have to share it around a bit for the kudos. Then it's in the wild.


Absolutely. That would scuttle GPS tracking until a way was found to spot forged files. What a horrible thing to do. You'd have to question why someone with that amount of spare time and expertise, didn't offer to help with this project rather than look to spoil it.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 17 June, 2010, 07:40:23 pm
No it isn't, it's weaker. A till receipt is physical evidence that someone went somewhere to get it printed off at a certain time and date. A gpx file with one point per control is nothing more than proof that someone produced a gpx file. You can do this sitting at your computer. I have queried elsewhere whether even a full track is really evidence but at least it can be audited to see if it looks like a typical cycling track. Effective cheating would have to be fairly sophisticated.

Of course, that person needn't be the 'rider'. I could, for example, phone a chum in Harrogate and ask them to get an atm receipt one afternoon. Then I could stroll over the road to the shop and get a till receipt one morning, and again at teatime. I could kill two birds with one stone and take the dog out. Voila, proof of a 100km perm.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 17 June, 2010, 10:09:00 pm
No it isn't, it's weaker. A till receipt is physical evidence that someone went somewhere to get it printed off at a certain time and date. A gpx file with one point per control is nothing more than proof that someone produced a gpx file. You can do this sitting at your computer. I have queried elsewhere whether even a full track is really evidence but at least it can be audited to see if it looks like a typical cycling track. Effective cheating would have to be fairly sophisticated.

Of course, that person needn't be the 'rider'. I could, for example, phone a chum in Harrogate and ask them to get an atm receipt one afternoon. Then I could stroll over the road to the shop and get a till receipt one morning, and again at teatime. I could kill two birds with one stone and take the dog out. Voila, proof of a 100km perm.
Haven't we covered this ground already? My recollection is that it was generally accepted that the traditional paper method was open to forgery if someone was determined enough to do so, but that the rewards are so meagre that no one in their right mind would bother. (Digress here to discuss elsewhere whether riding a bike for X00km classifies you as out of your mind to start with.) Also, forgers and cheats with their eyes on any kind of "champion" status would soon be rumbled by the riding community. The "validation by GPS" system is roughly speaking no more, nor no less vulnerable to cheating but the same arguments for accepting this imperfect but generally very workable system apply, don't they?
Title: Re: Using tracklogs to validate DIY perms
Post by: Panoramix on 17 June, 2010, 10:09:39 pm
It would actually be quite risky to forge GPX as the validator probably keep them and it would be very easy to identify once the trick is found.

If GPX get recycled by changing the date, all the latitude longitude of the 2 tracks would be identical. Solution: write a script that compares tracks.

If people use info from google map or OSM, same as above but against tracks created by google/OSM

People driving around and changing the GPS timestamps: It is easier to  drive around and get receipts.

People generating trackpoints manually point by point: get a life it is easier to forge receipts.

I suppose photo evidence could be asked but then that is pointless because detractors are going to argue that photoshop is the arm of choice!
Title: Re: Using tracklogs to validate DIY perms
Post by: Karla on 17 June, 2010, 10:18:02 pm
You could take a digital photo at whatever date you like and alter the EXIF data.  Photos should be on 35mm film, preferably taken with the manual SLR carried around in your duck cotton saddlebag beneath your Brooks saddle on you Reynolds steel bike with Weinmann brakes and 3x5 downtube-shifted gears..
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 17 June, 2010, 10:23:03 pm

The problem is someone might just be nerdy enough to write the software just for the challenge without any specific intention of actually using it. Then they would have to share it around a bit for the kudos. Then it's in the wild.

Absolutely. That would scuttle GPS tracking until a way was found to spot forged files. What a horrible thing to do. You'd have to question why someone with that amount of spare time and expertise, didn't offer to help with this project rather than look to spoil it.

I've had a good long think about this (400s are good for that).

I think that it is an order of magnitude easier to write some software to help spot a forged track than it is to write some software to forge a track that will pass such an inspection. Also, the software can be improved, and previous tracks can be re-analysed. Given this, it's very very risky for someone to submit a forged track as it would be the end of their AUK membership.

Looking at it from the 'how to fake a GPS track' angle there are a couple of options:-

The easiest way to forge a track is to submit a previously ridden track with the dates timeshifted. This will only work once per previously ridden track though, do it again with the same track (even if some 'noise' is added) and it would be quite easy to spot.

I think the best solution for this is to still require some paper based proof of passage along the way, which would then have to tie in with the GPS tracklog. It's going to be very hard to fake the timestamps and route to do this and not add in tell tale signs of modification in the data. It also requires some effort to get these proofs-of-passage, even if you're ringing your mate somewhere and asking him to collect a receipt for you in some other town.

For an un-ridden route you can create a GPS tracklog using something like bikehike or bikely, even if you add 'noise' to this it's going to be very hard to get the timing information right based on gradient and the like. Lots of telltale things like slowing down for junctions, stopping at roundabouts, etc.

If the tracklog contains HR info, cadence info and even Power info then you're stuffed. That's going to be nigh on impossible to plausibly fake. From my own investigations into this I have a general idea what a HR plot for a long ride should look like and you don't need a computer to spot the fake tracklog, you just need the computer to draw the graph or apply some simple algorithm to it and then let a human interpret the results.

Cadence, for example, would be tricky to fake. You'd have to make sure that the resulting scatterplot of speed vs cadence made sense. I plotted this for the my ride of the Snowdon and Coast 400 and from the graph you can have a good guess at the gearing setup of my bike. There are two distinct areas of points relating to the two chainrings, and several straightish lines (there's quite a bit of noise but it is based on 25000 points) that hint at the underlying linear nature of the commonly used gear ratios. It's not enough to pick out the cassette/sprocket sizes but with some clearing up you might be able to. Try faking that over a whole ride, or even sections of ride, the faking program would have to consider what gear would be sensible for the current speed and not change up/down oddly).

Add in HR; which lags behind effort by a few minutes and so lags behind slope changes, is affected by wind, has a general downward trend over a long ride, etc. Power even more so, that becomes very hard to accurately fake for an entire ride, you only have to look at the graphs/analysis you can get from WKO+ or Golden Cheetah to see why, any slight anomaly will show up as a superhuman effort.

It may not help spot fakes if the data are not there (it would be foolish to try and fake such data), but the presence of the data will make it much easier to verify as a genuine file. If 95% of submitted files are easy to verify as being real it means more time can be spent scrutinising the 10% that aren't so easy to verify (but are still probably not fakes).

Make it known that effort has gone into all of this, that the likelyhood of being caught is quite high (and your data will be kept so that it can be re-analysed in the future), and that the consequences of being caught are severe and I doubt you'll see a problem.

Danial, I'll gladly put some effort towards this, I've had a number of ideas about what I'd do if I were trying to both fake the tracks and spot the fakes, and I have a fair understanding of GPS, GPX and the underlying maths/physics and programming required, plus I've got a bunch of example GPX files I can use (including my DIY rides up to Cambridge which I could use to splice together to create a whole bunch of permutations of rides).

Writing software to spot a forged track is quite hard, writing some software to do some analysis, present some graphs and summary data that a human can interpret and look for telltale signs is much easier, and is all that is needed for this job. This is much easier than writing software to convincingly fake the track in the first place (let alone fake it manually) as you have to do a pretty damn good job of that otherwise you're screwed.

Having a few bits of paper evidence are also key as they should do enough to deter the opportunist. As I understand it, DIY by GPX was designed to allow otherwise unavailable places to be used as controls to keep the route to a minimum, given this there should be no problem still stopping at 3 or 4 places on the route to gather a quick receipt.

Anyway, enough for now.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 17 June, 2010, 10:27:16 pm
If GPX get recycled by changing the date, all the latitude longitude of the 2 tracks would be identical. Solution: write a script that compares tracks.

Adding noise can help this, but you'll still need to move points around otherwise it'll be obvious that you're within 100m of your previous ride on this route at all times. The 'time-in-hand vs distance traveled' graph would allow you to stop this quite easily.

If people use info from google map or OSM, same as above but against tracks created by google/OSM

Exactly, it's pretty easy to generate these tracks yourself and see how close the data points are. Note that going down this route would require timing data to be faked so that the speeds are accurate, this means relying on gradient/slope information derived from the notoriously inaccraute DEM data of bikehike/gmaps/etc, plus it would be easy to compare the speeds in the GPX file to the expected speeds based on such inaccurate DEM data (in other words, you'd need to know how/where to fake data that was inconsistent with the DEM data).

People driving around and changing the GPS timestamps: It is easier to  drive around and get receipts.

Again, the speed/timestamp issue is a lot of work to fake.

People generating trackpoints manually point by point: get a life it is easier to forge receipts.

Heh, easier to ride the thing in the first place.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 17 June, 2010, 11:10:30 pm
Danial, I'll gladly put some effort towards this, I've had a number of ideas about what I'd do if I were trying to both fake the tracks and spot the fakes, and I have a fair understanding of GPS, GPX and the underlying maths/physics and programming required, plus I've got a bunch of example GPX files I can use (including my DIY rides up to Cambridge which I could use to splice together to create a whole bunch of permutations of rides).

Writing software to spot a forged track is quite hard, writing some software to do some analysis, present some graphs and summary data that a human can interpret and look for telltale signs is much easier, and is all that is needed for this job. This is much easier than writing software to convincingly fake the track in the first place (let alone fake it manually) as you have to do a pretty damn good job of that otherwise you're screwed.

Awesome! I'll email you.

Having a few bits of paper evidence are also key as they should do enough to deter the opportunist. As I understand it, DIY by GPX was designed to allow otherwise unavailable places to be used as controls to keep the route to a minimum, given this there should be no problem still stopping at 3 or 4 places on the route to gather a quick receipt.

I've had an idea about this. Came to me this afternoon...
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 17 June, 2010, 11:10:41 pm
I have to say I'm surprised the GPS validation doesn't require, say, 1 piece of "paper" brevidence so that you at least have to leave the room your computer is in.

don't worry sonny;

we will find cheats out (and you thought that electronic brevet card was just a simple Word document; it's sending all sorts of spy files to your gps as we speak)

and then all of YACF will know about it  ;)
Title: Re: Using tracklogs to validate DIY perms
Post by: MSeries on 18 June, 2010, 07:20:49 am
Danial, my offer to help with LEL and other stuff extends to this.
Title: Re: Using tracklogs to validate DIY perms
Post by: MattH on 18 June, 2010, 07:31:42 am
Cadence, for example, would be tricky to fake. You'd have to make sure that the resulting scatterplot of speed vs cadence made sense. I plotted this for the my ride of the Snowdon and Coast 400 and from the graph you can have a good guess at the gearing setup of my bike. There are two distinct areas of points relating to the two chainrings, and several straightish lines (there's quite a bit of noise but it is based on 25000 points) that hint at the underlying linear nature of the commonly used gear ratios. It's not enough to pick out the cassette/sprocket sizes but with some clearing up you might be able to. Try faking that over a whole ride, or even sections of ride, the faking program would have to consider what gear would be sensible for the current speed and not change up/down oddly).

That's fine until you get those cheats who only use a single gear :-)

Validation by having your brevet card signed, timed and dated by a notary public is the only way forward.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 18 June, 2010, 08:46:56 am
Having a few bits of paper evidence are also key as they should do enough to deter the opportunist. As I understand it, DIY by GPX was designed to allow otherwise unavailable places to be used as controls to keep the route to a minimum, given this there should be no problem still stopping at 3 or 4 places on the route to gather a quick receipt.
I've had an idea about this. Came to me this afternoon...

Chaps, can I put in a plea for you not to go overboard on this? Your level of computer/GPS expertise is far and away beyond my comprehension but I do wonder if perhaps some of you are getting carried away with the intellectual challenge presented by a problem which probably exists more in the imagination than in the real world.

For me, the totally paperless, completely till receipt/stamp/tangible evidence free system offered by GPS validation is a huge benefit. Anything which is added to the procedure as a defence against a perceived risk of cheating and which complicates the purity of the simple paperless method needs in my opinion to be severely measured on a "cost vs. benefit basis". I don't know the direction in which your thoughts might go, but the requirement for example to get even one piece of paper from a control in the middle of the night can easily screw up an otherwise perfect route for a DIY 400km say, so please, if at all possible, can we keep it all paperless?
Title: Re: Using tracklogs to validate DIY perms
Post by: perpetual dan on 18 June, 2010, 09:28:09 am

The problem is someone might just be nerdy enough to write the software just for the challenge without any specific intention of actually using it. Then they would have to share it around a bit for the kudos. Then it's in the wild.

Absolutely. That would scuttle GPS tracking until a way was found to spot forged files. What a horrible thing to do. You'd have to question why someone with that amount of spare time and expertise, didn't offer to help with this project rather than look to spoil it.

I've had a good long think about this (400s are good for that).

I think that it is an order of magnitude easier to write some software to help spot a forged track than it is to write some software to forge a track that will pass such an inspection. Also, the software can be improved, and previous tracks can be re-analysed. Given this, it's very very risky for someone to submit a forged track as it would be the end of their AUK membership.

This skirts near something I'm thinking about at work, around plausible deniability - so I guess I should put my hand up to nerdy enough.  :-[   I agree, not easy to do well over the prolonged period of an audax. I'm happy to contribute if I can and you'll know if I've been naughty because I'll publish my findings!

... no, I can't see the point of doing this in an audax either.

Title: Re: Using tracklogs to validate DIY perms
Post by: The Mechanic on 18 June, 2010, 10:25:52 am
Is audaxing such a major issue that people will go to such lengths to get rides validated when they have not done them.  I would hope that AUK members were above this sort of behaviour.  If not, then we should start psychometric testing of members to ensure that only the "right sort" get membership. :thumbsup:
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 18 June, 2010, 10:35:48 am
For me, the totally paperless, completely till receipt/stamp/tangible evidence free system offered by GPS validation is a huge benefit.

True, but at the moment it doesn't exist, the trial is over.

If a strong enough case can be put together that all cheating will be detected then I'm sure the committee would go for it, however I'm not sure this can be done with just GPX files for the reasons I've highlighted above

There are two types of DIY by GPS being discussed in this thread:

1) The use of a GPX tracklog as proof-of-passage for places where normal controls are not available, but normal receipts/ATM stamps are still required along the way for other controls. This makes it much easier to plan rides that go where you want and are not massively overdistance. But you'll still need to stop for food at some point on the ride and it's unlikely that you won't go through at least a few places where it's possible to spend a couple of minutes stopped to collect an ATM or shop receipt. Not every control can be a GPS control and, ideally, the entire GPX tracklog should be submitted, not just little snippets around the various GPS controls.

2) Full proof-of-passage by GPX tracklog alone, no other 'brevidence' required.

"If at all possible" is the key phrase, that's what I want too, but only if it's workable.
Title: Re: Using tracklogs to validate DIY perms
Post by: saturn on 18 June, 2010, 11:09:34 am
For me, the totally paperless, completely till receipt/stamp/tangible evidence free system offered by GPS validation is a huge benefit.

True, but at the moment it doesn't exist, the trial is over.


Huh? I thought the trial was over and the live paperless system had been launched. Have I missed something?
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 18 June, 2010, 11:20:05 am
For me, the totally paperless, completely till receipt/stamp/tangible evidence free system offered by GPS validation is a huge benefit.

True, but at the moment it doesn't exist, the trial is over.


Huh? I thought the trial was over and the live paperless system had been launched. Have I missed something?

Sorry, brain fart, that was the GPS for AAA points trial.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 18 June, 2010, 12:09:19 pm
There are two types of DIY by GPS being discussed in this thread:

1) The use of a GPX tracklog as proof-of-passage for places where normal controls are not available, but normal receipts/ATM stamps are still required along the way for other controls. This makes it much easier to plan rides that go where you want and are not massively overdistance. But you'll still need to stop for food at some point on the ride and it's unlikely that you won't go through at least a few places where it's possible to spend a couple of minutes stopped to collect an ATM or shop receipt. Not every control can be a GPS control and, ideally, the entire GPX tracklog should be submitted, not just little snippets around the various GPS controls.

2) Full proof-of-passage by GPX tracklog alone, no other 'brevidence' required.

"If at all possible" is the key phrase, that's what I want too, but only if it's workable.
Sorry? This is the first I've heard of two sub-types. As I tried to express in an earlier post, a half-and-half system can often suffer from the same problems as the purely paper system. Option (2) is what's required and I've already started using it, thanks and it's great!
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 18 June, 2010, 12:31:00 pm
Is audaxing such a major issue that people will go to such lengths to get rides validated when they have not done them.  I would hope that AUK members were above this sort of behaviour. 

I believe it was in the past  :-\
Title: Re: Using tracklogs to validate DIY perms
Post by: Panoramix on 18 June, 2010, 01:06:18 pm
Is audaxing such a major issue that people will go to such lengths to get rides validated when they have not done them.  I would hope that AUK members were above this sort of behaviour. 

I believe it was in the past  :-\

Well it was not endemic and did not have many consequences on AUK except the 50% rule!!!
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 18 June, 2010, 01:17:47 pm
The unanswerable question is whether the current rules are unnecessary (i.e. no-one would cheat even if the proof-of-passage requirements were relaxed) or whether no-one cheats because of the rules and proof-of-passage requirements.
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 18 June, 2010, 01:30:54 pm
Quote
If people use info from google map or OSM, same as above but against tracks created by google/OSM

The current software as written by Pete and used by Danial already spots that type of thing, and very impressive it is too. 
While it was being trialled, I did this - drew a track in Google Earth (this creates a track without any timestamps) and then substituted in timestamps from an actual ridden event to simulate a cycled track.  The problems showed up instantly in the software.  It wasn't so much the mismatch between gradients and speeds which was what I expected to see - it was the occasional very high speed spikes caused by dead straight sections of road (trackpoints placed impossibly far apart).
Title: Re: Using tracklogs to validate DIY perms
Post by: dkahn400 on 18 June, 2010, 02:27:56 pm
Quote
If people use info from google map or OSM, same as above but against tracks created by google/OSM

The current software as written by Pete and used by Danial already spots that type of thing, and very impressive it is too. 
While it was being trialled, I did this - drew a track in Google Earth (this creates a track without any timestamps) and then substituted in timestamps from an actual ridden event to simulate a cycled track.  The problems showed up instantly in the software.  It wasn't so much the mismatch between gradients and speeds which was what I expected to see - it was the occasional very high speed spikes caused by dead straight sections of road (trackpoints placed impossibly far apart).

You occasionally get these in genuine tracklogs too, caused by temporary position error: a sudden dart out to a single spurious point many kilometres off track, then a dart back on track. Of course visual inspection of the track makes the reason obvious in this case.

On the question of whether people would actually be motivated to submit forged tracks, I think that's somewhat beyond the point. A validation system should be sufficiently robust to make cheating improbable whether it's expected or not. I also think it's important to explore potential approaches to cheating in order to be confident of producing a system that precludes it. In particular discussing such strategies openly is a Good Thing (TM) as security by obscurity is inherently flawed.  I'm impressed in particular by Greenbank's arguments and am now officially changing my position from skeptic to supporter of validation by tracklog. No system is perfect but the tracklog system now appears to me much more robust than the current one, particularly with the amount of effort being proposed.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 18 June, 2010, 05:27:11 pm
I also think it's important to explore potential approaches to cheating in order to be confident of producing a system that precludes it. In particular discussing such strategies openly is a Good Thing (TM) as security by obscurity is inherently flawed.  I'm impressed in particular by Greenbank's arguments and am now officially changing my position from skeptic to supporter of validation by tracklog. No system is perfect but the tracklog system now appears to me much more robust than the current one, particularly with the amount of effort being proposed.

Did you not know that we already analysed the correlation between change in elevation and speed of submitted tracks?
Title: Re: Using tracklogs to validate DIY perms
Post by: dkahn400 on 18 June, 2010, 05:47:32 pm
I also think it's important to explore potential approaches to cheating in order to be confident of producing a system that precludes it. In particular discussing such strategies openly is a Good Thing (TM) as security by obscurity is inherently flawed.  I'm impressed in particular by Greenbank's arguments and am now officially changing my position from skeptic to supporter of validation by tracklog. No system is perfect but the tracklog system now appears to me much more robust than the current one, particularly with the amount of effort being proposed.

Did you not know that we already analysed the correlation between change in elevation and speed of submitted tracks?

That's precisely the sort of thing that tracklog spoofing software would, er, spoof.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 18 June, 2010, 07:36:28 pm
Well, quite. But did you know that that's one of the things we checked?
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 18 June, 2010, 11:44:13 pm
I also think it's important to explore potential approaches to cheating in order to be confident of producing a system that precludes it. In particular discussing such strategies openly is a Good Thing (TM) as security by obscurity is inherently flawed.  I'm impressed in particular by Greenbank's arguments and am now officially changing my position from skeptic to supporter of validation by tracklog. No system is perfect but the tracklog system now appears to me much more robust than the current one, particularly with the amount of effort being proposed.

Did you not know that we already analysed the correlation between change in elevation and speed of submitted tracks?

That's precisely the sort of thing that tracklog spoofing software would, er, spoof.

True, but it's extremely hard to spoof convincingly.
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 19 June, 2010, 12:01:28 am
Care here - I haven't tested it recently, with the latest firmware release, but previously my Satmap ran out of track after about 240km, even using the "coarse" recording option. A particular pain as I was doing a 300km DIY. Had I been trying to validate it by GPS, I'd have been well annoyed, since there was no visible way of knowing it had given up the ghost since the Trip Log (but not the recorded track) was still accruing.

I just dumped and inspected the log on my Satmap Active 10, which has just been sat plugged into the PC.  It's been recording for ten days, and has just under 32500 track points using the power saving 4s/sample mode.  Clearly that isn't the correct number of data points, it should be over 200000.  That's simply because coverage in my living room is a bit indifferent, and requires a relatively unusual configuration of the satellites to provide a good fix, so there are big blanks in it.

Even assuming it's being limited by the number of data points (which isn't necessarily the case, the last data point was at the point that I dumped the track), that still represents over 1½ days of recording.

It clearly isn't limited by memory, since the memory status screen says that I've used less than 1% of the capacity of Internal Flash Storage (actually it says I've used 0%, but that's clearly not true!).  That makes sense, since even if you assumed 32 bytes used per sample, that would only be 1M of storage used, and since these days gigabytes of flash are common (I don't know how much internal flash it has, but I'd assume 1G or more), then you wouldn't have even started to make a dent.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 19 June, 2010, 07:50:05 am
Care here - I haven't tested it recently, with the latest firmware release, but previously my Satmap ran out of track after about 240km, even using the "coarse" recording option. A particular pain as I was doing a 300km DIY. Had I been trying to validate it by GPS, I'd have been well annoyed, since there was no visible way of knowing it had given up the ghost since the Trip Log (but not the recorded track) was still accruing.

I just dumped and inspected the log on my Satmap Active 10, which has just been sat plugged into the PC.  It's been recording for ten days, and has just under 32500 track points using the power saving 4s/sample mode.  Clearly that isn't the correct number of data points, it should be over 200000.  That's simply because coverage in my living room is a bit indifferent, and requires a relatively unusual configuration of the satellites to provide a good fix, so there are big blanks in it.

Even assuming it's being limited by the number of data points (which isn't necessarily the case, the last data point was at the point that I dumped the track), that still represents over 1½ days of recording.

It clearly isn't limited by memory, since the memory status screen says that I've used less than 1% of the capacity of Internal Flash Storage (actually it says I've used 0%, but that's clearly not true!).  That makes sense, since even if you assumed 32 bytes used per sample, that would only be 1M of storage used, and since these days gigabytes of flash are common (I don't know how much internal flash it has, but I'd assume 1G or more), then you wouldn't have even started to make a dent.
Fair enough. Perhaps the truncation of my 300km ride track was caused by something other than pure memory. I did say it wasn't on the latest firmware when it happened. The point I was making was not to take it for granted; like many aspects of cycling, it pays to test your kit thoroughly in real life situations before using it in mission critical situations!
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 19 June, 2010, 08:19:57 am
...The point I was making was not to take it for granted; like many aspects of cycling, it pays to test your kit thoroughly in real life situations before using it in mission critical situations!

Fair comment.  I do tend to carry two GPSs, one the mapping one I use for route finding, and the other a simple data logger (the IgotU), which gives me a record even if the first one dies for some reason.
Title: Re: Using tracklogs to validate DIY perms
Post by: Jord on 19 June, 2010, 09:42:53 am
I also doubt if the Oregon will record much over 300K before it starts re writing the track. I would need to save the ride at 300K and then start again so to speak and then join the two tracks!

Title: Re: Using tracklogs to validate DIY perms
Post by: The Mechanic on 21 June, 2010, 09:00:24 am
I am faily sure that the track recording feature of my Vista HCX starts a new track every day.  This means that if you go over to the next day, one track with stop recording and a new one will begin.  However, they will both be saves so you should be able to combine them.  Never tried that though.
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 21 June, 2010, 09:40:02 am
Neither type (Etrex, or touchscreen) will lose any tracklog data, they both archive stuff to SD card before it gets lost.  Retrieving it is another matter. 
The Etrex needs to be set up appropriately, to do daily archiving - its not the factory default.
The touchscreen types do it automatically, but not on a daily basis, just on a 'memory getting full' basis.
Either way its there on the SD card, sometimes needs a bit of work to reconstitute it the way you want.
Title: Re: Using tracklogs to validate DIY perms
Post by: dkahn400 on 21 June, 2010, 04:27:38 pm
Well, quite. But did you know that that's one of the things we checked?

Not specifically. How would I?
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 21 June, 2010, 05:05:42 pm
another interesting point that's come up today;

if the direct shortest route between controls specified on the entry form is say 201km but the actual route ridden as shown on the gpx is 220, does the ride qualify for the extra time allowance relative to the extra distance ridden? (obviously as long as that longer distance is within time)

on a receipt based system that would only get the allowance for 220 if that was the minimum,
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 21 June, 2010, 05:10:46 pm
I don't see why it should change. If the shortest distance between controls, agreed up front, is 201km, then that's all you get time for, no matter how far you end up riding.
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 21 June, 2010, 05:13:11 pm
I don't see why it should change. If the shortest distance between controls, agreed up front, is 201km, then that's all you get time for, no matter how far you end up riding.

That's my thinking too. GPS validation is merely an alternative to the current (working) system.
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 21 June, 2010, 05:15:45 pm
I don't see why it should change. If the shortest distance between controls, agreed up front, is 201km, then that's all you get time for, no matter how far you end up riding.

yes but under the paper system you could only guarantee that the minimum distance had been ridden whereas with a gpx it's proven that they rode the extra distance. I have a tracklog from yesterday that shows just this anomaly (the rider did the L2B as most of the first half which considerably increased the overall time)

I'll raise it with The Management tonight...

I suppose the moral is if you think the gps is going to take you all over the shop on the route either ignore it and take your intended route or make sure you specify the extra controls upfront.
Title: Re: Using tracklogs to validate DIY perms
Post by: Manotea on 21 June, 2010, 05:17:54 pm
I don't see why it should change. If the shortest distance between controls, agreed up front, is 201km, then that's all you get time for, no matter how far you end up riding.

That's my thinking too. GPS validation is merely an alternative to the current (working) system.

Except GPS validation allows you to claim those extra KMs by adding additional waypoints, hence this thread (http://yacf.co.uk/forum/index.php?topic=34447.0).
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 21 June, 2010, 05:19:56 pm
Martin:
That would be like going off route (on a 'normal' perm) and getting an extra receipt to prove where you'd been - I wouldn't expect extra time for my diversion.
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 21 June, 2010, 05:21:00 pm
I don't see why it should change. If the shortest distance between controls, agreed up front, is 201km, then that's all you get time for, no matter how far you end up riding.

yes but under the paper system you could only guarantee that the minimum distance had been ridden whereas with a gpx it's proven that they rode the extra distance. I have a tracklog from yesterday that shows just this anomaly.

I'll raise it with The Management tonight...

So you could, theoretically, get to the 150km mark and realise you'd be out of time if you followed your intended route (201km) but by going a longer route (with a nice flat section) you can make up some time. Doesn't sound very fair to me.

I could imagine it could be useful if there was a genuine reason for having to make a detour (unexpected road closures due to roadworks or RTA) but, other than that, it just looks like trying to compensate for poor route planning.

You don't get extra time in Audaxes for going off-route.

DIY with GPS controls should allow you to place a control where there's no chance of getting a normal proof-of-passage, which should mean you can keep your intended route down to 201km.
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 21 June, 2010, 05:21:23 pm
I don't see why it should change. If the shortest distance between controls, agreed up front, is 201km, then that's all you get time for, no matter how far you end up riding.

That's my thinking too. GPS validation is merely an alternative to the current (working) system.

Except GPS validation allows you to claim those extra KMs by adding additional waypoints, hence this thread (http://yacf.co.uk/forum/index.php?topic=34447.0).

yes of course but only if you specify those additional waypoints on the entry from
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 21 June, 2010, 05:22:44 pm
I don't see why it should change. If the shortest distance between controls, agreed up front, is 201km, then that's all you get time for, no matter how far you end up riding.

That's my thinking too. GPS validation is merely an alternative to the current (working) system.

Except GPS validation allows you to claim those extra KMs by adding additional waypoints, hence this thread (http://yacf.co.uk/forum/index.php?topic=34447.0).

Well. It might allow it - but I don't think it's right. It's all after the fact, and not in the spirit of the occasion.

Are you saying, if I were to deviate from an agreed route by (say) 30km on a traditional non-GPS validated event, providing I got PoP for that extension, I'd be allowed extra time? Because that's what it sounds like you are saying.

Being able to prove you rode further is immaterial - the "contract" the rider has with the event is the agreed list of controls and shortest distance between. Period.

Edit: Jeez - bit of a cross-post fest there...  ;) I think we all agree  ???
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 21 June, 2010, 05:25:46 pm
I don't see why it should change. If the shortest distance between controls, agreed up front, is 201km, then that's all you get time for, no matter how far you end up riding.

That's my thinking too. GPS validation is merely an alternative to the current (working) system.

Except GPS validation allows you to claim those extra KMs by adding additional waypoints, hence this thread (http://yacf.co.uk/forum/index.php?topic=34447.0).

Well. It might allow it - but I don't think it's right. It's all after the fact, and not in the spirit of the occasion.

Are you saying, if I were to deviate from an agreed route by (say) 30km on a traditional non-GPS validated event, providing I got PoP for that extension, I'd be allowed extra time? Because that's what it sounds like you are saying.

that would not be allowed;

if the shortest route between all the control points is 230km that's the time you are allowed (same as on a calendar non BRM event), you can't then extend the route on the fly

(looks like I've just answered my own question!)
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 21 June, 2010, 05:30:31 pm
Yes.

DIY with GPS controls should allow you to place a control where there's no chance of getting a normal proof-of-passage, which should mean you can keep your intended route down to 201km.

Sorry, and I meant that with the extra GPS controls you can make the shortest route distance match the intended route much more closely, so your shortest route will be nearer 220km and you'll have the appropriate amount of 'extra' time.

I did a DIY 200 that took me exactly 14 hours due to various reasons (long lunch, chain woes, it being 220km on the road, and horrible mist limiting my speed on the descent of Yad Moss to 20kph!). Luckily the shortest distance agreed with the DIY organiser was 205km so I was just in time (205/14.3 = 14h20m). I would have been a minute out of time if I had entered 200km on the entry form (200/14.3 = 13h59m10s).
Title: Re: Using tracklogs to validate DIY perms
Post by: Manotea on 21 June, 2010, 05:48:06 pm
Its not really a cross post fest; its all part of the same problem issue.

Traditionally, I'd plan a nominal 200km route with say, 5-6 control points. If it comes out at, say, 225km on the road. Am I bovvered? Not really, as personally I'm comfortable covering 225km within the 200km time limit although it might be irrating if I'm pressed for time on the day, i.e., I need to be home by x o'clock or I'll turn into a pumpkin.

However if I'm doing a GPS validated route then its easy peasy to add in more controls and aim for a slightly shorter 'circuit' and so achieve a route of 200km by shortest distance between controls (fewer KMs on the road) or retain the original route which is now 225km shortest distance by controls (more time). Technically one could do this now but there is a big disincentive not to because stopping to collect a physical control every 10~15km is pretty boring/expensive, but that's not the case for GPS validated routes, as our esteemed DIY Orgs are discovering.

I agree the current rules for the DIYs should apply but with the introduction of GPS DIYs additional guidence might be required regarding the maximum number of controls.

The Orgs of course have the ultimate sanction of refusing to process/validate routes which they feel have an excessive number of controls but that way lies ill will, which can be easily avoided by the proferring of guidence on the matter.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 21 June, 2010, 07:09:40 pm
We'll probably include guidelines for number of controls in the redrafted DIY by GPS guide, which will be on the AUK website in August.

They'll only be that, though. I'm happy to wade through a larger number of controls than usual, for a route that looks particularly exciting or interesting.
Title: Re: Using tracklogs to validate DIY perms
Post by: simonp on 21 June, 2010, 10:34:34 pm
ooh!  AAA points in Cambridgeshire!  Only 22 controls for a 100 needed.  ::-)
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 21 June, 2010, 10:35:42 pm
Is there another oddity here or do I have this wrong? I notice that on the AUK website, in the Individual Riders Results statistics if I ride say a "400" Calendar event which has been judged to have an actual distance of 407km (e.g. the Severn Across) although I obviously get only 4 points (one per round 100km) the "Total distance in all events this year" figure goes up by 407km. If however, I ride a DIY "400" which has an accepted minimum distance between controls of say, 412km (and regardless of the fact that my actual ride may have been 427km to avoid lunatic A roads, etc.) my "Total distance" figure is credited with only 400km.

I don't suppose this matters a jot, since I don't think the "Total distance" figure counts for anything (does it?) but it's perhaps another quirk, arising presumably from the way the system has evolved.

Separately, can someone - Danial or Martin perhaps - confirm that DIYs whether evidenced by paper or GPS get [actual agreed minimum distance between nominated "Controls"]km divided by 14.3 (for up to 699km) = time; so if you submitted a route/controls which couldn't be covered in less than 222km it would be 222km/14.3 = 15hrs 30mins for two points (and 200km onto your "Total distance", as above!)
Title: Re: Using tracklogs to validate DIY perms
Post by: simonp on 21 June, 2010, 10:39:08 pm
DIYs are presumably standard "events" which are always x00km.  Calendar events have their own distance calculated for each event.

The way the system works you'd have to create separate events for each ride.  Too much hassle?


Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 21 June, 2010, 11:05:13 pm
I don't suppose this matters a jot, since I don't think the "Total distance" figure counts for anything (does it?) but it's perhaps another quirk, arising presumably from the way the system has evolved.

I believe so - total distance counts for nothing. It was probably something that our esteemed web team realised was quite easy to add in there without breaking anything else. (I'm sure they'll be along to correct me if I'm wrong!)
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 22 June, 2010, 12:51:28 am
DIYs are presumably standard "events" which are always x00km.  Calendar events have their own distance calculated for each event.

exactly right; each DIY perm (and also ECE perm) has to be set up in its own right on the website (and one for each DIY organiser) so they are standardised in round 50 /100s of km

Separately, can someone - Danial or Martin perhaps - confirm that DIYs whether evidenced by paper or GPS get [actual agreed minimum distance between nominated "Controls"]km divided by 14.3 (for up to 699km) = time; so if you submitted a route/controls which couldn't be covered in less than 222km it would be 222km/14.3 = 15hrs 30mins for two points (and 200km onto your "Total distance", as above!)

yes; DIY's are BR not BRM so any overdistance is allowed pro-rata;

the same applies to ECE's but the calendar event must be completed within the minimum time for the event not the total ECE time if this is slower; as it is eligible for calendar points if over 200km, whereas the ECE bit is eligible for perm points (if the calendar event is less than 200 all points are perm)
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 22 June, 2010, 06:43:36 am
DIYs are presumably standard "events" which are always x00km.  Calendar events have their own distance calculated for each event.

exactly right; each DIY perm (and also ECE perm) has to be set up in its own right on the website (and one for each DIY organiser) so they are standardised in round 50 /100s of km
I see. So does that mean that if I set up a proper Permanent rather than a DIY and have it published and open to all and it were say, minimum 210km around the controls, it would accrue 207km on their "Total Distance" for anyone who rode it?

Separately, can someone - Danial or Martin perhaps - confirm that DIYs whether evidenced by paper or GPS get [actual agreed minimum distance between nominated "Controls"]km divided by 14.3 (for up to 699km) = time; so if you submitted a route/controls which couldn't be covered in less than 222km it would be 222km/14.3 = 15hrs 30mins for two points (and 200km onto your "Total distance", as above!)

yes; DIY's are BR not BRM so any overdistance is allowed pro-rata;

the same applies to ECE's but the calendar event must be completed within the minimum time for the event not the total ECE time if this is slower; as it is eligible for calendar points if over 200km, whereas the ECE bit is eligible for perm points (if the calendar event is less than 200 all points are perm)
Thanks Martin for the confirmation.
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 22 June, 2010, 09:32:54 am
So does that mean that if I set up a proper Permanent rather than a DIY and have it published and open to all and it were say, minimum 210km around the controls, it would accrue 207km on their "Total Distance" for anyone who rode it?

yes; just checked my results for this year and the total includes the extra 5km I did on the Pulborough -Reading 205 perm, but a flat 100 and 200 for the ECE and DIY.

but yours would accrue 210 Shirley?  ;)
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 22 June, 2010, 10:09:42 am
I see. So does that mean that if I set up a proper Permanent rather than a DIY and have it published and open to all and it were say, minimum 210km around the controls, it would accrue 207km on their "Total Distance" for anyone who rode it?

Yes.

Just remember though that Calendar events (and perms) have 3 distances associated with them:-

Nominal distance for awards (i.e. 50km, 100km, 150km, 200km, 300km, 400km, etc)
Minimum distance between controls (for the Brevet card timings)
Route distance according to routesheet

Taking one Audax as an example (Phil's old route for the Upper Thames), it was a 200km ride, with 208km shortest distance between controls, but to pick nicer roads than the main roads the shortest route would use it used a route that was 213km.

The Brevet card timings should be based on the 208km figure, but the website will record 213km since people want to know how long the route is (I know some would be annoyed if they entered a calendar event that said '201km' and found out it was 220km unless they went main road bashing).

The website then uses the 213km figure in the total distance calculation even though some of the riders will may take a shorter route (but still over 200km).

As for DIYs, it would mean creating a separate DIY entry for every unique ride distance over 200km. Unnecessary overhead really.
Title: Re: Using tracklogs to validate DIY perms
Post by: phil d on 22 June, 2010, 10:52:07 am
That's the theory, but as it happens the practice is slightly different!  The brevet card timings (on this event) have always been based on routesheet distances, not minimum distances.  That's because I put them into the on-line system like that (wrongly, presumably).  I suppose I had better correct that for this year, though it's not a BRM event so it hardly matters.

Given that I don't recall noticing differences between the brevet card distances and the routesheet distances on other events I've ridden, I would guess that I'm not alone with this error.
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 22 June, 2010, 11:04:17 am
I would have thought all brevet card timings (which only key off real controls and checkpoints not infos) were based on the route sheet; to put the shortest possible distance would end up with the distances in the boxes being at odds with the routesheet which would be very confusing if we were talking about 8km, the whole brevet card is automatically defined by what information has been put in Event Planner.

GB; the only possible reason I can suggest for this discrepancy is that the org has gone in and put the control distances in and then after discussion with their regional events sec over the event distance has changed the distances, and this has not been changed on the website as once events are approved orgs have limited rights to change the event details.

I have absolutely no idea what the shortest distance between controls on my events is, and would not even know what to use to measure them; I know Autoroute is useless for it as it suggests a few shortcuts that are not even roads; as does viamichelin (again this is where discussion takes place with the regional sec to keep the route above a minimum distance)
Title: Re: Using tracklogs to validate DIY perms
Post by: Greenbank on 22 June, 2010, 11:05:19 am
Given that I don't recall noticing differences between the brevet card distances and the routesheet distances on other events I've ridden, I would guess that I'm not alone with this error.

I've definitely noticed it on some. My stack of cards is at home so I can't give an example.

I think this is all something that's not rigorously enforced within AUK, not that this is a problem.
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 22 June, 2010, 02:46:32 pm
So does that mean that if I set up a proper Permanent rather than a DIY and have it published and open to all and it were say, minimum 210km around the controls, it would accrue 207km on their "Total Distance" for anyone who rode it?

yes; just checked my results for this year and the total includes the extra 5km I did on the Pulborough -Reading 205 perm, but a flat 100 and 200 for the ECE and DIY.

but yours would accrue 210 Shirley?  ;)
Oops, a typo - yes, that's what I meant.
Title: Re: Using tracklogs to validate DIY perms
Post by: AndyH on 22 June, 2010, 09:34:49 pm
Danial, I have read your article in arivee about this. Apologies for jumping into this so late (and if I have missed stuff and the q has already been answered please bear with me.)

Firstly congratulations for the obvious effort that this has required.

Secondly, I have just posted the following in another thread : "This is probably a stupid question, but if you can prove a DIY with GPS, why not a perm ?

Finally I think that what you need is an unadulterated GPX file. I have a Garmin 305 that records in a different format. I have to export to GPX. Is this acceptable ?

Andy





Andy
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 22 June, 2010, 09:55:25 pm
Secondly, I have just posted the following in another thread : "This is probably a stupid question, but if you can prove a DIY with GPS, why not a perm ?

Hi Andy

We could validate any sort of ride this way, in theory. This is quite new territory for AUK though, so I suspect this is as far as we'll go for now. I'm winding my side of this down now, so we can see how the new system settles in.


Finally I think that what you need is an unadulterated GPX file. I have a Garmin 305 that records in a different format. I have to export to GPX. Is this acceptable ?

Oh yes, if that's what it takes. Does your Garmin record a .tcx file?
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 22 June, 2010, 11:31:29 pm
Secondly, I have just posted the following in another thread : "This is probably a stupid question, but if you can prove a DIY with GPS, why not a perm ?

We could validate any sort of ride this way, in theory. This is quite new territory for AUK though, so I suspect this is as far as we'll go for now.

Wot Danial said (and also the same for ECE's as it would involve having to mix gps with paper to join the two events in unholy matrimony)

the other thing is that ordinary perms are organised by ordinary organisers who probably prefer the paper system they have used for years rather than gps which as well as other things is aimed at Reaching the Parts other ATM's Cannot Reach
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 23 June, 2010, 09:06:26 am
I can see a possible niche market in "classic routes" as pre-planned GPS perms, with routesheets, eatery tips etc. And it could save all that info checking.

Fred Whitton route, old calendar events with tricky controls (Daylihgt 600)?. Continental classics (P-Roubaix etc).

What hoops would an organiser have to jump through? Do they just need the Wand of Tracklog Verification?
Title: Re: Using tracklogs to validate DIY perms
Post by: frankly frankie on 23 June, 2010, 09:15:44 am
Just remember though that Calendar events (and perms) have 3 distances associated with them:-

Nominal distance for awards (i.e. 50km, 100km, 150km, 200km, 300km, 400km, etc)
Minimum distance between controls (for the Brevet card timings)
Route distance according to routesheet

That was interesting - you're right of course but Phil and Martin are also correct in the way they describe what actually happens, to construct the Brevet Card.

There is, strictly speaking, only one 'Event Distance' field in the data.  This is entered as an 'actual' distance and the Calendar display rounds it down to the nominal one (unless its below 100, where no rounding occurs).

It occasionally happens that the Finish distance (in the box in the brevet card) is higher than the 'actual' Event distance.  This is because the Event Distance gets locked down quite early in the process (so that the Calendar doesn't keep changing) whereas the brevet card construction could be ongoing much nearer the actual event.

Quote from: mattc
I can see a possible niche market in "classic routes" as pre-planned GPS perms, with routesheets, eatery tips etc. And it could save all that info checking.

That's an excellent idea.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 23 June, 2010, 11:24:55 am
I can see a possible niche market in "classic routes" as pre-planned GPS perms, with routesheets, eatery tips etc. And it could save all that info checking.

Fred Whitton route, old calendar events with tricky controls (Daylihgt 600)?. Continental classics (P-Roubaix etc).

What hoops would an organiser have to jump through? Do they just need the Wand of Tracklog Verification?

Sounds like you just talked yourself into a job.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 23 June, 2010, 03:08:04 pm
If the Wand of Tracklog Verification is to be made available to Organisers who volunteer, then please can I have it? It will rejuvenate the Badby permanents that I organise which are rather lame now that even the pub in Badby has closed. And it'd be nice to offer GPS validation on the Middle Road perms too.

I see no reason to not show anyone a copy of the validation software that we use. However I'll just check with Pete, as he designed it. Others have copies of it, and no doubt some misanthrope is already trying to work out a way to fool it, so it's hardly a state secret.

As for using it for your perms, I think that might have to wait a bit, while we digest the current developments.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 23 June, 2010, 04:06:55 pm
Danial, my offer to help with LEL and other stuff extends to this.

Hi Martin

Sorry, I totally forgot to reply to this. Are you 3coasting this weekend?
Title: Re: Using tracklogs to validate DIY perms
Post by: mattc on 23 June, 2010, 05:23:19 pm
I can see a possible niche market in "classic routes" as pre-planned GPS perms, with routesheets, eatery tips etc. And it could save all that info checking.

Fred Whitton route, old calendar events with tricky controls (Daylihgt 600)?. Continental classics (P-Roubaix etc).

What hoops would an organiser have to jump through? Do they just need the Wand of Tracklog Verification?
Sounds like you just talked yourself into a job.

Doh!  :facepalm:

Recent experience suggests I should learn how to log my own rides before being let loose on Bigger Things.  :-[

Of course, we wouldn't even need 'proper' routesheets if riders are happy to follow a GPS track...  ( :facepalm: x2 )
Title: Re: Using tracklogs to validate DIY perms
Post by: Ivo on 26 June, 2010, 02:48:28 pm
Neither type (Etrex, or touchscreen) will lose any tracklog data, they both archive stuff to SD card before it gets lost.  Retrieving it is another matter. 

I accidentaly found a method around that. For the trip I did the last two weeks I carried 3 micro-SD cards with 3 sorts of maps on them. Swapping as I pleased. When getting the mapping right via my netbook I discovered all sorts of data on my older micro-SD cards. Checking them I discovered a lot of logs part of them I considered lost. So after the White Nights 1200 I pieced together the entire tracklog on the basis of the various data on the micro SD cards (I used 2 during the ride, one with OSM, the other with the Garmin maps). It was quite easy, just putting the micro-SD card in a card reader for an SD slot and opening the various daylogs in Mapsource. THen it's the usual sticking together of pieces of track.
Title: Re: Using tracklogs to validate DIY perms
Post by: Ivo on 26 June, 2010, 02:59:52 pm
I can see a possible niche market in "classic routes" as pre-planned GPS perms, with routesheets, eatery tips etc. And it could save all that info checking.

Fred Whitton route, old calendar events with tricky controls (Daylihgt 600)?. Continental classics (P-Roubaix etc).

Especially the continental classics are nearly impossible to squeeze into the classic paper permanent system. Some fairly straight-line might, some very winding ones (Amstel, Flanders) will be impossible. Having them in a sort of GPS route databank would be possible, I'd be prepared to do at least the Amstel and possibly Flanders and LBL.
Title: Re: Using tracklogs to validate DIY perms
Post by: DanialW on 27 June, 2010, 02:33:22 am
Ooh Ivo, you are good.

I doubt this will happen this year, as we really need to let what we've got bed in yet. However the work on the software is done for now, so when we look at this again, I'll drop you a line.
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 27 July, 2010, 09:14:25 pm
I received an interesting gpx yesterday; it simply ran out of memory to store the track points (1 every second) on a 300;

something that hadn't occurred to me before. In light of this it's probably a good idea to get (or keep) a receipt at a few points just in case  :)
Title: Re: Using tracklogs to validate DIY perms
Post by: Weirdy Biker on 27 July, 2010, 09:47:26 pm
I got an interesting gpx yesterday; it simply ran out of memory to store the track points (1 every second) on a 300;

something that hadn't occurred to me before. In light of this it's probably a good idea to get (or keep) a receipt at a few points just in case  :)

Or pedal faster   :P
Title: Re: Using tracklogs to validate DIY perms
Post by: Chris S on 27 July, 2010, 09:49:48 pm
Sounds like a setting needs changing perhaps?

My Vista Cx is set to "Auto" interval, and it had 27% memory free after a 600 recently. Not sure what that means comparitively speaking.
Title: Re: Using tracklogs to validate DIY perms
Post by: Sergeant Pluck on 27 July, 2010, 09:55:12 pm
I got an interesting gpx yesterday; it simply ran out of memory to store the track points (1 every second) on a 300

Have you:
1. Got it set to store tracks to the card rather than internal memory?
    Menu>Menu>Tracks>Setup>Data Card setup> Log Track to Card
2. In Map Setup > Tracks have you got it set to 10,000 points rather than the default 3000?
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 27 July, 2010, 09:55:28 pm
Sounds like a setting needs changing perhaps?

the track in question came from a SatMap (never heard of it but the screen shot looked pretty natty)
Title: Re: Using tracklogs to validate DIY perms
Post by: RichForrest on 27 July, 2010, 09:56:01 pm
I've only had trouble with mine half way around the 1200.
I had the track loaded as an active log but halfway though the 2nd day it started to loose the track in front of me as I went.
So you could probably do 1800 - 2000km on the right setting  ;)
Title: Re: Using tracklogs to validate DIY perms
Post by: TimO on 27 July, 2010, 11:03:13 pm
the track in question came from a SatMap (never heard of it but the screen shot looked pretty natty)

The Satmap Active 10 can only sample at either 1 sample/sec in normal operation, or 1 sample/four seconds in battery saving mode.

It shouldn't even come close to running out of memory to store the data (I don't think I've managed to get the internal flash used above 1%), but it's possible a bug in the code caused it to stop recording for some reason.

I've had mine plugged into an external power source (laptop) and continuously recording for several days (although that's just a big blob of points around my house).
Title: Re: Using tracklogs to validate DIY perms
Post by: PloddinPedro on 28 July, 2010, 04:10:06 am
I have a Satmap and I've encountered this before, having had the track recording terminate after about 240km from memory. Satmap users should get into the habit of using the "Convert Trail to Track" facility periodically, I suggest at each Control, to ensure this problem is avoided.
Title: Re: Using tracklogs to validate DIY perms
Post by: perpetual dan on 28 July, 2010, 01:03:09 pm
Sounds like a setting needs changing perhaps?

the track in question came from a SatMap (never heard of it but the screen shot looked pretty natty)

The track you found a bit big from me was also from a SatMap, and I think I run mine in battery saving mode!
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 05 August, 2010, 09:35:46 pm
new system for online entry here

Audax UK DIY Events (http://www.aukweb.net/events/diy/index.htm)
Title: Re: Using tracklogs to validate DIY perms
Post by: toontra on 05 August, 2010, 09:55:52 pm
new system for online entry here

Audax UK DIY Events (http://www.aukweb.net/events/diy/index.htm)

Thanks Martin - this is good news!  Two questions - reading the notes it says not to save the track to the GPS unit.  That would be OK for anything up to 300k, but when I do multi-day rides I save the track in the Vista HCx at the end of each day, so ending up with multiple files.  They seem very detailed and not over-compressed (i.e. they show 20-yard deviations from taking a wrong turn!).  Is it still the case that these would not be valid?

Also, if the tracklog is interrupted for any reason (changing batteries, losing signal) then the tracklog is divided into segments (denoted by the prefix "seg").  At the moment I open the tracklog with a text editor and remove these bits, thus making a single track.  This is much better for loading into Ascent or other readers.  What would AUK's view be on this sort of manipulation?
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 05 August, 2010, 10:07:04 pm
new system for online entry here

Audax UK DIY Events (http://www.aukweb.net/events/diy/index.htm)

1. Two questions - reading the notes it says not to save the track to the GPS unit.  That would be OK for anything up to 300k, but when I do multi-day rides I save the track in the Vista HCx at the end of each day, so ending up with multiple files.  They seem very detailed and not over-compressed (i.e. they show 20-yard deviations from taking a wrong turn!).  Is it still the case that these would not be valid?

2. Also, if the tracklog is interrupted for any reason (changing batteries, losing signal) then the tracklog is divided into segments (denoted by the prefix "seg").  At the moment I open the tracklog with a text editor and remove these bits, thus making a single track.  This is much better for loading into Ascent or other readers.  What would AUK's view be on this sort of manipulation?

1. Yes import the whole track from the device and send it to a participating DIY org; not entirely sure what not saving it on the unit means.

2. If the tracklog is unclear I open it up on Mapsourse to find out what is going on; it's usually fairly easy to work out which tracks are the actual ride and combine two or more tracks together to get a total distance and time. No need from my experience to try to combine it;

the gpx validation program also shows a map of the route so we can work out where you have been and when and the whole system works very well

Danial's probably a Bear of Less Little Brain to answer the finer points   :-[
Title: Re: Using tracklogs to validate DIY perms
Post by: toontra on 05 August, 2010, 10:13:39 pm
1. Yes import the whole track from the device and send it to a participating DIY org; not entirely sure what not saving it on the unit means.

I was referring to the bit in the "DIY by GPS guide" which says:

Quote
Do not save your tracklog on the gps unit at the end of your ride. This compresses the tracklog and could make validating your ride more difficult. Instead, upload the tracklog from your GPS unit straight to your computer when you get chance.
Title: Re: Using tracklogs to validate DIY perms
Post by: fuaran on 05 August, 2010, 10:34:50 pm
On most Garmins, if you choose to "Save" the track, it will compress the track to less than 500 points, and it strips out all of the timestamps. I think its the timestamps that matter for DIY validation, as you need to prove what time you were at each control etc.

So instead, you should always download the "Active log" (which has all of the timestamps) from the Garmin, without saving it.
Or the best option, if you have a Garmin with a memory card, is to set it to log the track to the card. Then it will store it in full detail, with timestamps, as one GPX file per day, and you don't have to worry about running out of memory.
Title: Re: Using tracklogs to validate DIY perms
Post by: toontra on 05 August, 2010, 10:40:14 pm
Or the best option, if you have a Garmin with a memory card, is to set it to log the track to the card. Then it will store it in full detail, with timestamps, as one GPX file per day, and you don't have to worry about running out of memory.

Ah yes, I understand!  Yes, I do save to a memory card and this keeps the tracklog in full detail.
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 05 August, 2010, 10:42:11 pm
thanks for pointing that out fuaran; yes we need an active log uncompressed straight from the device to be able to validate it; without dates and times (and presumably elevations too for AAA) it won't work.

if you are a regular user of this scheme it's also very useful to name each tracklog you submit with an easily recognisable name for future reference; I personally don't like opening the gpx files with Mapsource as it then saves them as .gdb by default which don't work; although sometimes have to.
Title: Re: Using tracklogs to validate DIY perms
Post by: phil d on 06 August, 2010, 09:47:53 am
if you are a regular user of this scheme it's also very useful to name each tracklog you submit with an easily recognisable name for future reference.
Perhaps a convention agreed between the GPS validators would be a good idea.  I would certainly be perfectly happy to rename the files to a name convention that suits you.  At the moment the name is merely the date I rode as created by the GPS.
Title: Re: Using tracklogs to validate DIY perms
Post by: RichForrest on 06 August, 2010, 10:08:32 am
I name every ride/gps file I do with what it was, usually the same as I've put on the entry form. e.g. Spalding Mildenhall or East Anglian 300 ect
I don't think the name matters as long as the information needed is in the file.
Title: Re: Using tracklogs to validate DIY perms
Post by: Martin on 06 August, 2010, 11:40:34 am
I name every ride/gps file I do with what it was, usually the same as I've put on the entry form. e.g. Spalding Mildenhall or East Anglian 300 ect
I don't think the name matters as long as the information needed is in the file.

I do the same before I even ride the event as that's how I navigate; and then just save it under the same name as a gpx for validation
Title: Re: Using tracklogs to validate DIY perms
Post by: Jord on 10 August, 2010, 05:36:40 pm
I rode my first Perm by GPS on Monday and must say it is a massive leap forward (well for those with a GPS!) and will be doing all my perms this way from now on.

Brilliant idea.