Friday, November 27, 2009

Fishy Marketing : The Slippery Speedplay Mannequin

"I'm at the Speedplay Booth. Their leg mannequin has the biggest ass I've ever seen."
- someone at Interbike this year.

While I appreciate bike technology in all forms, I can't stand the inglorious ways by which people try to sell it to you. Readers may know that I run a section on this site titled "Marketing Mishaps". For some time now, I have been collecting events in our biking world that seem fit for it, you know - haphazardly done marketing through poor science, cheesy ad material and other nuances that just turn intelligent people off. I think I have found some new material today.

I present to you the "Slippery Speedplay Mannequin". It's all slippery (and smoke and mirrors too) if you read on.

Dynamic Test Procedure : Quickly, here's a summary of what Speedplay did to try and back up the superiority of their pedal design, the Zero. They placed the mechanized legs of an impressive mannequin (only legs) on a bike in the San Diego low speed wind tunnel. The legs were attached through cleats to the Zero pedals. The contraption was then made to pedal for a mere 5 minutes at 100 rpm in a normalized wind velocity of 30 mph. Apparently the tech guys did this twice with a 3 hole and a 4 hole mounting sole to capture any differences from mounting. Finally, they compared the results to the same procedure done to two other competitor pedals from Shimano and Look (brand was kept secret).

What To Measure? : Speedplay was interested in measuring the drag co-efficient, Cd, multiplied with frontal Area, A of the mannequin and bike system. This term appears in the equation for retarding drag force in cycling. I have written the equation for you below and what the terms mean :

It appears that even Speedplay is muddled with the terms and their definitions. In several places, they write as if they're measuring the term drag co-efficient Cd when even the computer screen in their report shows "CdA". On top of that, they take this to be a dimensionless quantity. I wonder what kind of drink the author may have had the night before?

Where Measured : San Diego Low Speed Wind Tunnel at the Air & Space Technology Center. Test section dimension of facility is 2.44 x 3.66m. Test section cross-sectional area is 8.50m^2.

Results : Going with the poorly presented results of the test, here's what I think I gleaned from it. Tabulated for you, these numbers are for one test for each item, for a duration of 5 minutes and 100 rpm cadence. Please note, all these numbers are claimed by Speedplay. The percentage differences between each line item were done by me.

Conclusions To Customers : Speedplay goes on to claim that their calculations show such drag reductions result in a time saving of 5.5 seconds/hour and 33 seconds/hour for 3 and 4 hole mounts respectively. This, they say, is equivalent to the savings gained from replacing a standard wheel with a deep section, aero front wheel.

The fishy things going on in this whole agenda are the following :

1. Time savings for whom? : While the contraption is really impressive, the 33 second savings computed by Speedplay, if correct, are for the lower legs of a "robot" riding into 30 mph headwind in a wind-tunnel specifically with 4 hole mounted cleats. C'mon, even an ape won't believe that an actual human being using this will get the same amount of claimed benefits.

2. As opposed to what? : The number of pedals in the test are small (2) and the specific brands chosen have been hidden from us. Which is understandable but again, I suppose any idiot could test the Zero pedals with a competitor's junk hardware from the past years and say that it's better. Were all brands tested the latest in market?

3. 33 seconds savings, really? : Those claimed savings seem artificially huge to me. Just for an illustration, the 2004 Nike "Swift Spin" time trial suit prototype (with tracksuit and leggings), worn by a pro cyclist, showed a time savings of 33 seconds when pedaling into 32 mph wind, over its 2003 development model. This suit is still considered by many to be state-of-the-art stuff and a production model was used in a couple of Tour de France's. To claim that switching to a small pair of pedals under a robot's legs equal the time savings of a top aerodynamic piece of apparel worn by a actual human in aero position points to something extremely fishy in the calculations. It even diminishes the many years of work Nike and other researchers conducted in trying to create a more aero suit for pro cyclists.

4. Where's the math? : Obviously, what Speedplay fails to show is the methodology behind their conclusions. How did they arrive at 33 seconds/hour time savings? Moreover, they don't investigate the variation of CdA numbers as the sample size increases by limiting themselves to one test run for each type of pedal. The worst part is, they test each pedal for 5 minutes. Hence, we don't have an indication of the level of error and range of CdA values over many trials. Now you have to ask, is this really 33 second time savings? Or something smaller?

The bottomline?

As is apparent to others, Speedplay wants you to buy their Zero Pedals which will free you of between $130-$330 (Chromoly-Titanium). They calculate that if you cut your legs apart, dispose of the trunk and then pedal a bike in a rare and bloody time trial of 5 minutes keeping everything tight and in-plane like a mannequin, you'll save as much time riding into a 30 mph headwind as does tossing out a 32 spoke wheel for a slick aero wheel in the front.


Cyclocosm : Are You A Speedseeking, Torso-less Pair Of Legs?

Alien Biker : The Missing Link, The One Piece Of Gear That Will Help You Ride Like A Pro

Slow-Twitch Forums : Speedplay Claims Huge Wind Drag Reduction Over Leading Brands

* * *


Will said...

The mannequin developed is very impressive. I'm a Speedplay user for the past 4 years. While I did think I was using it for speed, I attributed it to lower weight on climbs.

Anonymous said...

Seems like they don't even know what they're trying to prove? And is this system meant for a human or a mannequin? Muddled is not even the right word.

Bill said...

They should have just modelled this on a computer and done a fluid flow analysis. This is stupid. And wind tunnel testing is not cheap you know.

Anonymous said...

That was a brilliant photo at the end there. The man standing next to the dismembered mannequin as if its the solution for all our ills. I don't quite think I'm ready to cut myself open to gain the so-called "33s time savings."


I second Craig Wallace first comment. The fact that Speedplay has been ignorant about the critiques of these claims show that they're totally in a different world of their own. This is pretty shameful for a company to leave untouched and if anything, I expect them to atleast make a few decent changes to the writeup in the coming days.


I second Craig Wallace first comment. The fact that Speedplay has been ignorant about the critiques of these claims show that they're totally in a different world of their own. This is pretty shameful for a company to leave untouched and if anything, I expect them to atleast make a few decent changes to the writeup in the coming days.

Anonymous said...

So, can someone tell me...
If I pedal slightly toe down (which at 100rpms for me, at least, is guaranteed), effectively shielding the pedal from the the magical theoretical advantage of Speedplay negated? BTW, Richard Bryne (man shown) is the owner of Speedplay, but more interetingly, a lawyer. what you want with that info...I'm certainly not implying that a lawyer could, or would manipulate data to reflect their (marketing)needs..."snick"

Yokota Fritz said...

Good call on that, Ron.

Has Speedplay been given an opportunity to respond? I'd be curious what they say.

Anonymous said...

Speedplay's owner is a lawyer.

Well, well...

Anonymous said...

I'm surprised that what is normally a quite rational blog like Cozy Beehive would start bashing speedplay pedals. You dont need to test a pedal system to recognize that the frontal area of a speedplay pedal and cleat is smaller than the frontal area of a shimano, look or time pedal. It therefore has less drag. Converting an aero benefit into an approximate time savings is a common way to make the general public grasp the overall advantage of a particular product. Is your criticism that they didnt run the test for long enough to be statistically valid? Is there something fundamentally wrong with their protocol? Or is it just that they condensed the result into a soundbyte?

Anonymous said...

Its Anon again. Yes I am from a science background, but not anything related to fluid engineering. Just being honest.

I might not have made it clear in my post that the aero benefit primarily comes from the narrower, smooth spindle of the Stainless and Ti pedals. This is where I believe there's a real difference between Speedplay and other pedal systems which have a much wider axle, especially with a composite body pedal like a Look Keo.

I agree that the pedaling leg is a bit of a marketing ploy, but I bet a wind tunnel would still reach the same fundamental conclusion with Foam Dave Zabriskie over 100 minutes of testing.

My point is that the average consumer doesn't have the background in statistics to care that the testing doesn't necessarily prove that it saves exactly 33 seconds but might save between 15 and 45 seconds. I agree that they could do more testing and narrow it down, but I doubt anybody would care except bloggers and shop rats.

I'm not too fond of using time units t express an aero advantage. If I had my way, all aero benefits would be expressed as watts saved at 40km/h.