Crossfit Open 2014: Stats, Ranks, and Data-Nerding

The CrossFit community is a welcoming community, but it is a welcoming community built upon the competitive nature of a very particular type of person. With every WOD there is competition with yourself (i.e. setting new a PR), competition with the other athletes in your gym (I’m looking at you Lance), and once a year there is a competition among all CrossFit’ers in the form of the CrossFit Games.

I am a member of CrossFit 206 in Seattle. The coaches at 206 have built an environment that is inclusive; 206 caters to both the most intense of athletes (cough, cough Evan) and to those that are just going to have a good time. It is a great blend of people and I am thoroughly grateful. With the start of the Games though I have begun to wonder where in the spectrum of gyms 206 falls. With the wealth of data made available through the Games website it is just too tempting for me not to nerd out and answer that seemingly simple question.1

I am going to preface everything to come with (1) I am not actually learning about the gym per se, but rather about the team the gym puts forth. It is not a minor distinction so I want to make it explicit. (2) For tractability reasons I have only included CrossFit’ers in the USA.

I think the natural starting place is to look at the number of reps that athletes were able to complete in a rather brutal 10 minutes. reps_wod1

The histogram of the performances of athletes is rather striking. The pink-ish bars are the number of women that did a certain number of reps, and the green-ish bars are the equivalent for men. Those distinct peaks in the histogram correspond to the power snatches portion of the workout.

The histogram of all athlete’s performance doesn’t do justice to the distinctness of those peaks. If I zoom in on just the central three peaks I get this: reps_wod1_zoom_not_marked

The leading edge of the peak corresponds to the transition between double-unders and power snatches. It makes sense that with a few seconds left an athlete wouldn’t have time to get set for a snatch and just give up after the double-unders. What strikes me is the dramatic drop off of athletes that finished with 13 or 14 snatches relative to those who finished with between 5 and 12. I’ve marked those drop offs with arrows on this plot. reps_wod1_zoom

The dramatic drop off could be attributed to a couple of things. The first explanation is that athletes who would naturally finish at 13 or 14 kicked in the “after-burners” in order to complete the snatches; I find this credible, though I know at 9:55 in the workout I had absolutely nothing left. What doesn’t jibe with this explanation is why those in reps 5 through 12 didn’t also kick in the after-burners, which would fill in the gap and leave a smoother transition. The second explanation is a little more nefarious in that the judges were a little generous with the clock when the athletes needed to get just that one more rep. Unfortunately I find this explanation both credible and quite likely. Whatever the reason for these striking patterns in these data I find it neat, and I mean what is a second or two among friends? Honestly for 99 percent of people we’re just doing this to have fun, so who cares about a little fudging.

But back to the main question, how does 206 stack up to other gyms? Since the Open is by definition open to athletes of all shapes, sizes, ages, and genders it doesn’t really make sense to compare a gym of mostly 20-something college kids to a gym of equally capable but older athletes. The Open addresses this by creating “Masters” categories and breaking out rankings by gender. I want to take that same idea and go just a bit further. For all the data nerd-ing to follow I am going to normalize2 an athlete’s performance against that of their peers, with a peer defined as an athlete of the same age and gender.

For benchmarking a gym I think the most obvious measure is the average performance of their athletes once age and gender has been accounted for. So what is the average performance of 206’s athletes relative to the average performance of all other gyms? CrossFit 206 is 2,536 out of 3,648 gyms3 competing in the Open; conditional on the inclusive environment 206 has developed I think that is pretty darn good. In case you’re curious where your gym falls in the spectrum the full list can be found here. (link)

Despite CrossFit’s “hardcore” reputation, performance isn’t everything. To me a good mix of people is just as, if not more important than how we stack up in a once a year competition. I like the term “inclusive” but you can use just about any word you want to describe the intangible feel of a gym. Almost by definition the intangible feel of a gym is difficult to quantify but I am going to measure it as (1) the mix of men and women and (2) the dispersion in age of athletes. Once again I feel compelled to caveat these two measures with the fact that an athlete must choose to compete in the Open (i.e. it is not random) and I have a strong suspicion that the choice to compete is related to the age and the expected performance of an athlete.

Despite this limitation I think I find some neat results. The average gym has 32 athletes competing and of those 41 percent of those are women. There is a wide range in the gender mix but very few teams are dominated by either men or women. female_fraction

Taking this one step further, when the women at a gym perform better are the men likely to perform better also? The answer is yes, there is a positive relationship between how the women do in a gym and how the men do. female_male_performance

This is reassuring. My take is that good coaching techniques lead to better outcomes for both men and women. Isn’t this the point of CrossFit? To master fundamental, all purpose exercises that are sport and gender independent?

Now that I’m thinking about performance, I wonder if gender mix affects a gym’s performance? The simple answer is there seems to be a positive relationship between the fraction of women at the gym and the gym’s overall performance, but only to a certain extent. To answer I had to turn to a regression5 based approach. Here is a picture of the gym’s expected performance as a function of the fraction of women in the gym. female_fraction_expected_peformance

I caution against drawing too strong of conclusions, or any conclusions for that matter, from this simple plot. It seems though that gyms that are dominated by either gender do worse than those who have a good mix. I am open to speculation about this from the CrossFit community.

Age dispersion is another dimension of inclusive-ness in my book. I have had my ass handed to me by AARP members as well as kids too young to have a drivers license. CrossFit is an equal opportunity ego-shatterer. A far as gyms go the average age is 32 avg_age_hist

but what I find more amazing is the dispersion in age of the gyms. The average gym has 31 years between its oldest competing athlete and its youngest competing athlete. age_spread_hist

Does this age dispersion have an effect on performance? Do the old-timers impart wisdom on the young bucks? age_spread_expected_performance

Unfortunately the answer is probably not. There doesn’t seem to be a strong relationship between the age dispersion and performance.

So far I have been looking at average gym performance, but as I mentioned earlier we also compete as individuals. I am not going to highlight my spectacularly mediocre performance in 14.1, but I have put together a list of personal rankings. By normalizing by age and gender I think a fair comparison can be made between a high school young’n, a kick-ass mother of two, and a cubicle bound older gent. Here is the full list, but as a heads up, it is a large file. (link) Under this ranking system Pam Kusar (age 53) of CrossFit Akron is number 1 when she completed 352 reps. That is stellar!

This little data-nerding exercise was fun. It satisfied my curiosity. I am not going to read too much into my performance or my gym’s performance on one workout in the Open. To me CrossFit is about having a good time and that’s all I care about.

1 Dear CrossFit Games website, this is the day and age of open data and mashups. Making it easier to collect and build on the wealth of data provided by the games is mutually beneficial.

2 Normalize means I take an athlete’s performance minus the average peer athlete’s performance divided by the standard deviation of their peer group. I require a gym to have at least ten athletes in the Open in order to get into my analysis. I remove athletes who signed up but did not compete in 14.1. Additionally I require ten people to be in a peer age group in order for the athlete to be in the sample.

3 For this analysis a gym must have ten members that competed in the first round of the Open.

4 I measure dispersion as the difference in age between the youngest and oldest member of the gym.

5 I first run a regression of the gym’s performance on female fraction, female fraction squared, average age, average age squared, age spread, and age spread squared. The squared terms are included because I am worried about non-linearities. I then plotted the expected gym performance on the y-axis and female fraction on the x-axis. I then fit a loess regression to show a trend.

Leadville Trail Marathon: 2013

Leadville Trail Marathon

The Leadville Trail Marathon was quite possibly the greatest physical challenge that I have had the pleasure to endure. The course itself was great, and all things considered the race shouldn’t have been that difficult, but it seemed the universe conspired against me and everything that could go wonky did go wonky.

I got to Leadville, or more specifically the neighboring town of Frisco, two days before the race in a desperate attempt to acclimate. In Seattle, where I trained for the race, my GPS sometimes read below sea-level so almost needless to say the altitude bug bit me hard. Simply walking up the five flights of stairs to my hotel room required concerted effort; this did not bode well for the race.

The night before the race I wanted to get some carbs in me, and what is better than Italian food for carbo-loading? My family and I went to Tuscato Ristorante Italiano on main street in Frisco. I mention this restaurant by name, and very explicitly, because not only was their food awful but immediately after dinner every single person in my family had serious digestive issues. While I doubt it was food poisoning in the strictest sense, they must of used something vile in their sauce because I was physically in pain.

I hoped my digestive issues would pass by 4:00 AM when I woke to get ready for the race, but alas they did not. I didn’t want to eat or drink anything because something gnarly was happening inside me. I knew I needed to eat but my body just said NO! with emphasis on the exclamation point. My buddy Zach drove me and my brother-in-law Grant to Leadville from Frisco, and all I could think about was my gut. I started pounding Pepto because the thought of running while feeling like this scared me.

The race started with 100s of people milling around the starting line. In good form the race was started with the blast of a shotgun. Very quickly I got left behind by Zach and Grant. Not only are they in better shape than me but also they live in Denver which gives them a 6,000 foot acclimation advantage. About a mile in to the course the half-marathoners broke away from the marathoners as we transitioned from dirt roads to trail. At this point I had been so consumed by my digestive issues that I didn’t notice my asthma acting up. I had been fighting a cold for two weeks and when I have a cold my asthma can be problematic. I thought I had kicked the cold but apparently not.

At this point I think you can imagine why the Leadville Trail Marathon was the greatest physical challenge I have had the pleasure to endure. Luckily despite my body revolting I did enjoy the breathtaking scenery. Running through the forest was ho-hum, but once we got above tree-line the mountain views were simply amazing.

Leadville Trail Marathon Profile

The crux of the run was supposed to be the 2,000 foot climb to the high point of the race at over 13,000 feet. I say supposed to be the crux because I fell into a steady hiking pace and marched my way up. It wasn’t easy but it wasn’t agony inducing.

All things considered I was feeling pretty good when I got to the top of Mosquito Pass. Before the race I had been worried about calf cramps so I bought some Zensah sleeves. Maybe they worked or maybe it was a placebo effect but my calves felt strong even with all the climbing. After a brief pause at the top of Mosquito Pass I started the long run down, and like a fool I ran down the mountain. I made the same mistake of running too fast down a long hill at the Yakima Skyline Rim 50K. I felt great all the way down, and I was passing people left and right. I had hauled my 200 pounds of body weight up that mountain, and by golly I was going let gravity do its thing all the way down. This bit of gravity assisted fun took its toll. Once the course flattened out the lactic acid caught up and in the words of George Oscar Bluth, Jr (G.O.B.) I realized “I’ve made a huge mistake.”

With the supposed crux of the race behind me I thought the last 9 miles would be easy. A few rolling hills, a jog around a mountain, and then a 3 mile downhill to the finish line. I thought wrong. The last 9 miles was my personal crux. I only have myself to blame because I had hardly ate or drank anything since the start. Yes, I had been sipping some Roctane and slurping some GUs but because of my digestive issues, the altitude, and my asthmatic breathing I could not force enough nutrition down my gullet. The wheels fell off the wagon and I sunk into a death march of epic proportions.

I’ll spare you the details of the last 9 miles except to say that there was a lot of walking and cursing the mountain gods for making these “hills” so long.

The last leg of the race follows a long stretch of road through town. Despite being able to see the finish line, hear the music pumping, and practically taste the beer, I could not will myself to pick up the pace and finish strong. My overall performance was sad. I finished in a little over 7 hours, but damnit I did finish. Despite my objective failure at running a good race the announcer made me feel like I truly accomplished something; that simply surviving was an achievement.

I am sitting here writing this trip report after drinking some coffee from my finisher’s mug. I have noticed that I reach for that mug a lot. I don’t particularly like the shape of the mug, or the feel of the handle, but I still reach for it because damn I am proud of it. While the Leadville Trail Marathon was the most physically challenging event I have undertaken I can’t wait to do it again next year.

Leadville Trail Marathon

CrossFit as Ultramarathon Training

Yakima Skyline Rim 50K Ultramarathon

The Yakima Skyline Rim 50K is a trail ultramarathon in the high desert of Washington that traverses 31 miles and has ~9,500 feet of elevation gain. It was both my first ultramarathon and my first organized race of any distance. To be upfront about it, my complete lack of experience makes me wholly unqualified to offer advice on training, never mind training for an ultramarathon. That said running the Yakima Skyline Rim 50K was a transformative experience and I am going to share my atypical training experience none-the-less.

About six months ago I decided to train for the Leadville trail marathon. I started running consistently and built up enough endurance so that my long runs were in the high teens. Like so many novice runners I did too much, too soon and the end result was an inflamed posterior tibial tendon. Besides adding milage that my body wasn’t ready for I also purchased a pair of Merrell Road Gloves for my short runs. I really like the Merrell Road Gloves now that I have sufficient arch strength but at the time I had no business running in a minimalist type shoe for any distance.

My training ground to a halt because of my inflamed tendon. After a month of complete rest I started going on one and two mile runs. I slowly rehab’d my foot and about two months ago I was finally back to where I could run six miles pain free. At this point I wasn’t in good shape but I wasn’t in horrible shape either.

I started doing CrossFit because I was concerned that my foot wasn’t strong enough to handle the mileage of a traditional training program. The CrossFit gym I go to is CrossFit 206 in the Leschi neighborhood of Seattle. If you are looking to try CrossFit I would highly recommend CrossFit 206. Their workouts are fairly standard in that there is 15 minutes of mobility training, 30 minutes of strength training (deadlifts, squats, cleans, etc), and then the workout of the day (WOD). The WOD is an intense 5 – 15 minute workout that is nonstop and usually done as fast as possible.

The WODs leave you exhausted but it is only 15-ish minutes of exercise. Can that really be enough of a workout to adequately train for an ultramarathon? My full training program for the 50K was CrossFit three to four times a week and then going on one longish run, 6-10 miles, and a couple of short runs, 2-3 miles, after CrossFit sessions. Well, after only two months of going to CrossFit 206 I finished the Yakima Skyline Rim 50K with a semi-respectable time of 8:09. Surprisingly my body felt good and I was not zonked when I crossed the finish line. I’ll admit I was a little sore all over and my calves were acutely sore for the two days post-race but I have been more sore after some of the WODs. On a side note: the CEP compression socks I wore really helped control cramps and spasms in my calves as I climbed seemingly endless hills. Just look at the profile of the race and tell me that doesn’t look like a calf punishing day of fun.

Yakima Skyline Rim 50k Race Profile

I think the 15 minute CrossFit workouts were able to prepare me for an 8 hour run because for those 15 minutes the focus is solely on developing fundamental strength. By fundamental strength I mean strength developed by full-body exercises that engage all the primary muscles as well as the stabilizers that are so often neglected. The fundamental strength helped in a number of ways. While running on loose rock I noticed that I was more surefooted because of the stronger stabilizer muscles in my legs. While trudging up thousands of vertical feet of trail I was acutely aware of how much stronger my legs felt. Despite weightlifting being the antithesis of distance running, the squats, deadlifts, and cleans really paid off. While running down thousands of vertical feet of trail I noticed how much stronger my core was and how I could engage my core to control my descent and relieve my quads.

So is CrossFit good ultramarathon training? I’d say that it worked for me but I caveat that with the Yakima Skyline Rim 50K is “only” 31 miles. Would CrossFit be enough for a 50 or 100 miler? I think it would be if your longish run was scaled appropriately. Now that I have the ultra-bug I am toying with the idea of a 50 miler and I am pretty sure I am going to continue the CrossFit + one long run training plan.

Smith Rock: 2013

Smith Rock State Park

Smith Rock is a pretty amazing place.  I didn’t know what to expect.  Sure I had seen pictures and heard about the hard sport climbing but that didn’t quite prepare me for my first outing.

2013-03-20 09.44.03My buddy Clark and I had a couple of free days and decided to head to Smith Rock because the forecast said it would be sunny and warm.  The weatherman lied to say the least.  The first day we got rained on, hailed on, snowed on, and had to brace ourselves during the gusts as we crossed Asterisk Pass.  Not quite sunny and warm but even with the crummy weather we had a blast.

We first hopped on Cinnamon Slab (5.6) to get a feel for the rock.  I am very glad we did because climbing tuff was unlike anything I had ever climbed on.  It took a bit of time but my “vision” for the best hands and feet eventually came around and it was a very enjoyable climb.

We wanted to hit the classic moderates during our brief two day trip.  First on our tick list was Spiderman (5.7 – 2 pitches) so we scrambled through Astrick Pass and over to Spiderman.  It was slightly drizzling and neither one of us was super-thrilled to lead but Clark sacked up and lead both pitches of Spiderman with numb fingers on damp rock.  Even in those manky conditions it was easy to tell that this was a classic climb.  The route eats up gear and moving around the daunting roof is airy but super secure if you have the right size hands to jam.

Spiderman - Smith RockAt the base of Spiderman someone had written in chalk that their rope had got stuck.  We had heard that this was not uncommon so we opted to scramble down.  With the gusty winds it took us a bit to find the right trail down but even with dealing with the wind the scramble was faster and more secure than rapping the route.  Plus on the scramble there was a knotted rope to lower yourself into a mini-cave: how cool is that.

The sun came out as we were scrambling down and it was a much need blast of warmth to rejuvenate our spirits.  With the sun shining we moved over to Out of Harms Way (5.8), which is a half-trad half-sport route.  I lead this and had a surprisingly difficult time jamming up the flake.  It looked like it would be a couple of jams and I would be up but I managed to make it super awkward.  Once I got to the top of the flake I was in for a treat.  I had never pinched dime sized crystals to make upward progress but that was what was called for.  There were bolts every five feet so even with nubbins for hands and feet I felt good.

We basically called it a day after that and went to Bend, OR to get beers and burgers at Deschutes Brewery.  There is nothing quite like a cold beer after a good day of climbing.

Five Gallon Buckets - Smith RockOur main objective on the second day was to climb Wherever I May Roam (5.9 – 5 pitches) which is on the backside of the mountain.  Since it was a balmy 33 degrees we decided to wait ’til the afternoon with the hope of climbing in the sun.

We started the day with Five Gallon Buckets (5.8).  Climbing the huecos was pretty amazing.  It was a first for me and I enjoyed it so much I climbed it twice.

With the sun shining we moved to the backside and started Wherever I May Roam (5.9).  The cool thing about the route is that it is five pitches of sport climbing.  I typically think of sport climbs as one-pitchers but I guess not.  I took the first pitch (5.8) to get on top of the pillar.  The only thing special about the first pitch was how sharp the rock was on my freezing hands.  We had totally blown the timing and the sun hadn’t even touched this side of the rock yet.

2013-03-21 13.16.09Clark took the second pitch (5.9) which starts with a big step over an airy gap as you move from the pillar to the main face.  At this point the wind was blowing something fierce and my puffy jacket did little to keep me warm.

I took the third pitch (5.9) and in many ways this was the crux pitch.  If you have read anything about Wherever I May Roam you’ve probably read how people get “lost” on the face by following the wrong bolts.  I had read that also and I thought there was no way I was going to get lost.  Yup, I was wrong and got totally lost on the face.  Even looking back I can’t figure out exactly where I went wrong.  The problem is there are bolts every-which-way and there is not a clear path of least resistance.  Plus you can’t see the anchors until you are basically on top of them.  The best advice I can give for this pitch is to remember that the anchors are all the way around in the dihedral and to keep moving up and over.

Clark took the fourth pitch (5.9) and while I was belaying him snow was blowing up on me as I hung in my shaded belay.  I haven’t shivered that hard in ages and let me say that it was not even type II fun.  When I joined Clark at the fourth belay I was in full body convulsions mode and was not in the most pleasant mood, but in an effort to just keep moving I lead the mostly unimpressive fifth pitch (5.8).

Getting down was straight forward.  We rapped off the backside into a sandy gully.  The second rap was from a set of chains on the west side of the gully which drops you at the anchors for the third/fourth belay.  I can imagine the tiny belay ledge gets pretty crowded on a nice day.  After that there were two more rappels from obvious anchors.  Normally something goes wonky while I am rapping but this one went surprisingly smooth.

Once we were down, and out of the wind, it really hit me how great the route was.  If the whether had been nicer I think that this route would be in my top five favorite routes.  I would highly recommend it… on a nice sunny day.

All in all Smith Rock deserves its reputation as a world class climbing destination.  I can’t wait to get back there.

The top of Wherever I May Roam

The top of Wherever I May Roam

How to Choose a Climbing Rope

This article by is a good introduction to choosing a climbing rope.  I found the article because I need to pick up a fresh rope with my upcoming REI dividend and was searching for opinions.  I think I am going to pick up a Mammut Tusk 9.8mm 70m because it seems like a general purpose rope that will stand up to plenty of top-roping but is still light enough to take on the irregular alpine outing.  I have also had good experiences with Mammut ropes and they’ve built trust in my book.  I wasn’t planning on getting a 70m but the article made the good point that as the rope wears I’ll most likely chop off the ends to maximize its lifetime.  With a 70m there is more room to chop which is a plus.

One important point that I feel I must reiterate here is that you never want to use a sharpie to mark the middle of your rope.  The article says it best.

Finally, don’t use a magic marker to mark the middle of your rope. A report conducted by the UIAA found that using any kind of pen or marker to mark the rope results in a 50 percent decrease in strength! However, another report by Kolin Powick at Black Diamond found that this issue isn’t totally settled.