Thursday, April 7, 2016

Jackpots and High Value Reinforcers: Riding the Swing of the Pendulum

When I first started clicker training over 15 years ago, jackpots were somewhat popular. Examples of jackpots were a larger number of treats or a special treat. Since my standard treat was 2 hay stretcher pellets, the jackpots I used were a full handful of pellets, a couple peppermint horse treats or a human peppermint candy. My horses really like the peppermint horse treats and loved the candy. Sometimes I also used cut up carrots or apples, but I liked being able to keep the peppermints on hand when the carrots and apples didn’t keep well in my pocket. 

The way I understood their use was that when the horse offered extra effort, you could give a jackpot to communicate that was a really good try. Over time, however, jackpots fell out of favor. A study done with dogs and conducted by Dr. Jesus Rosales Ruiz and his grad students indicated that jackpots interrupted the flow of training, thereby actually slowing training, rather than aiding it. I could understand how this could be, as my horses savored the peppermints to say nothing of the time it took me to unwrap the candies. I felt badly fading them out at first, but over time, found that my horses worked just fine for the hay stretcher pellets alone. I stopped using the peppermints...well, except for one particular learner on which they continue to be very effective, that being my husband.

Several years later, I took Susan Garrett’s Recallers course for dogs. I did the course both with a horse and dogs. Susan
speedy recalls: a result of high value reinforcers and slow progression
stresses knowing what your dogs consider to be high value reinforcers and using them carefully, but definitely using them. So back I went into experimentation mode. Susan’s course helped me understand a different way of using them. Rather than using them to point out good effort in shaping, she used higher value treats as a balance to distractions. The world is a fascinating place to dogs and in order to gain and keep the dog’s attention, we used cheese, hot dogs, tuna fudge and other delectable items to reinforce the dog for doing what we asked, as opposed to sniffing in the grass or leaving to say hi to the neighbor.

This is when I developed my own foundational concept that while for dogs, distractions are usually things they want to get TO; for horses, distractions are usually things they want to get AWAY FROM. Yes, this is a generalization; dogs have fears and horses have interests. Professional dog trainers certainly see our share of reactive dogs in one end of the spectrum or another. Probably ponies are most notorious for being distracted by wanting to get TO something (GRASS!). But as a whole, horses’ problems with distractability include the wind, the leaf blowing, the scary plastic bag: all things which may result in spooking and leaving the premises. This was the reason, I thought, that high value treats won’t work for horses’ distractions. If I want to work with my dog’s distraction, all I have to do is become more interesting than the distraction. But for a horse, it doesn’t matter how good a treat I have. If that horse is afraid, he’s not going to be dissuaded by something tasty. I love chocolate and you can certainly use it to train me, and you can use it to reinforce me for staying away from the computer. But if I think I’m about to be chased by a bear, you aren’t going to get me to stand around just because you’ve got chocolate. (note: so instead of using high value reinforcers, one needs to be more skilled at breaking things down, reading the horse's emotional responses, and becoming more trustworthy than the "distraction" is scary)

So I continued to use high value reinforcers for dogs, but not for horses. 

This brings me to the present when I am starting to hear criticism of using high value treats for distracted dogs and I am considering using high value treats with horses again. 

The criticism I hear in the dog world, and so far it’s been second hand, sounds like what I would call inappropriate use because people are using them in situations that are more horse-like! If you have a reactive dog, and a strong stimulus is present, pulling out liverwurst and waving it in front of your dog’s nose to keep his attention is not addressing the problem of reactivity. Maybe your dog responds and maybe he doesn’t but in my view, the issue isn’t being properly addressed. It’s as if you were using peppermints and apples to get a horse past something scary. It might work, but unless it was a very minor stimulus, you likely haven’t changed the way the animal feels and you may need to do it each time to get that horse past the scary thing.

The way I use high value treats with dogs is to begin training where the dog can be successful and I use the lowest value treat available which the dog will respond to. This varies with the individual. Some dogs, represented as “not food motivated”, can only be enticed with the finest of cheeses at first. But as Ken Ramirez says, “if your dog isn’t food motivated, then he’s dead!”. In time, by building a relationship and understanding, those fussy individuals can be trained with plain kibble. 

But once behaviors such as attention, loose leash walking and sits, for example, have been taught in a quiet home environment, we need to slowly introduce distractions. That’s when I pull out a higher value reinforcer. Following Susan Garrett’s guidelines, I rank the distractions for the dog in addition to ranking food (and activity!) reinforcers. Then I balance them. For one dog, a tennis ball on the floor might cause mayhem, so I wouldn’t use that as an initial distraction. For other dogs that ball might be interesting but not highly distracting. If they showed interest in it by looking at it, and then looking at me, I’d reinforce with some cheese. In my mind, the dog says, “ooh, she’s much more interesting than that silly ball”, and we continue to work together. Then I transition back to kibble, even in the presence of the ball. And I find a slightly more distracting item, such as someone slowly rolling the ball back and forth as we walk by. Movement is always more interesting so the dog might look at the rolling ball, but then remember how interesting I am so look at me and stay close on the leash. Out comes the cheese again. Through this slow and steady progress up to more and more distracting things, I teach the dog that I am ALWAYS more interesting than whatever else he might see. Through this process, the dog actually becomes desensitized to distractions in his environment. Personally, I'm not a fan of a dog who stares at me obsessively, but checking in with me and being able to respond to simple requests in the presence of distractions is a goal. Only when the dog is this responsive, even working with kibble, is he ready for me to raise the bar again, when I pull out something special to maintain my special status. 

So why would I ever need anything even higher value? Well, life and the environment can only be controlled to a certain point. Once we step outside of the home environment, we are subject to unplanned distractions. I want to have a really, really good base before I risk outings with potential for the unexpected. When that Rottweiler comes around the corner unexpectedly and barks, or when the UPS man suddenly comes screaming in the driveway, or when that rabbit streaks across the road in front of us, those are times I want something incredibly valuable on me so I can reinforce good responses. I’m not using them to prevent my dog from looking. I’m using them because our incredible history has allowed the dog to respond to me even in the face of a barking Rottweiler, a UPS truck or a bunny and I want to have something that demonstrates how amazing that response was! 

Using high value reinforcers in this way is not interrupting a shaping session and it’s not using the food to distract the dog from something. The way I see it, it’s simply reinforcing behavior I want to see repeated and using a reinforcer worthy of the effort of the behavior. 

So, back to horses, why would I start using high value reinforcers again with horses? Part of my thinking comes from my experiences at NEI (see here for more on that), and partly from one memorable experience with an equine and a high value reinforcer.

When we were at NEI, our instructors stressed the importance of being aware of where the animal was when we reinforced. Now both dog and horse trainers know how to feed for position and to set up for the next rep. But the birds were excellent trainers on more careful thought of this...of being aware of where the history of reinforcement was delivered. If you reinforced a bird on a small board “station” on a perch for just one session, that bird would go directly to that station the next time he was out. If that’s what you want from that bird, that’s great, but if you want flexibility in the behaviors, it’s not so great to have him glued to that station. 

video
An example of this was one of my training sessions with the corvid. I was to train him to fly from one perch at the front of the cage (I’ll call this perch A), to another perch at the back of the cage (perch B). Through the use of prompting, it was pretty easy to get the bird to fly to that perch and put it on cue. But one time I marked his landing on B, and in bird speed, he hopped immediately back to perch A and then to a third perch which was right in front of me...and I fed him there. Big mistake. Even though I had marked the landing on perch B, the next several times I prompted him to perch B, he instead flew to the perch where I had fed him...once.

Now I do think there were some other factors, namely that the trainers at NEI rarely used verbal markers. Because the birds are almost always looking at them when they train (as opposed to horses and dogs when we want them going away from us or not looking at us at times), the NEI trainers simply feed when the bird does the correct behavior. So even though we conditioned the word “good!” in our early training with the birds, I don’t think it had the power that a click has on my dogs and horses. If my animals hear a click, you can be sure they will repeat that behavior, regardless of where I fed for it . That’s why I can click for a dog sitting and then toss the treat to reset. The dog will return to me to sit (which was where I clicked), not go sit where the food was tossed. 

But in other situations, it does make a difference. Feeding where the perfect horse would be is an example. If we click when the horse is in the correct position next to us, but then feed close to our bodies, that horse’s head is going to be more likely to be too close next time. Yes, it may be what happens between the click and the feeding, but that’s what happened with the bird as well and it affected his future behavior, not just his treat taking behavior. 

In any case, this has made me more aware of what places I may be building up a history of reinforcement for. The story it made me think of was when I first taught Rumer to load into a trailer. At the time, I was still using peppermints as jackpots. In this case, she had never seen the trailer before but had a good history of being reinforced for approaching and touching items which might at first have seemed scary. 

Rumer's comfort with the trailer is maintained by careful driving and not trucking her before she was ready
I used hay stretcher pellets for reinforcing each step up the ramp, allowing her to back off when she wanted. But the next time in, she didn’t get treats at the bottom of the ramp, only when she had progressed beyond the previous attempts. I was building a history of more reinforcement inside. When she got all the way into the trailer, I pulled out a peppermint candy and gave it to her. There was no interruption of shaping; she was where I wanted her to be. Then I asked her to back off (there were many steps through this process which I’m glossing over) and we walked around in a little circle and approached the ramp again. Well that little pony just about dragged me onto the trailer. It was as if she was saying “The good treats are inside!”. All the way in she went, and she did indeed, get a peppermint candy once inside. 
So in that case, it was pretty obvious that place equaled high value reinforcer, and that in time, the value of the reinforcer could transfer so that it was a high value place. Now obviously, just getting in the trailer is only the very first step. She still needed to learn about the butt bar, the ramp, the trailer moving, longer trips, etc. But her enthusiasm of going all the way inside has stuck with me and seems to be a good reason to consider what and where we are giving treats.

Thursday, March 31, 2016

Clicker Expo Cincinnati 2016 (part 2)

As I mentioned in my previous post, much of  my time at Clicker Expo was spent on talks which weren't directly about training but there were a few! The first was "The Sound of Silence: Accessing the Power of a Withheld Click" with Michele Pouliot. 

I like the term withheld click because it describes a moment when you could have clicked but didn't. We aren't talking about missed clicks here, but when one intentionally chooses not to click. In the talk she discussed guidelines for how to do this effectively and what to watch out for. 

Various reasons people withhold a click include shaping successive approximations, extinction, differential reinforcement, inducing resurgence and others. Using it inappropriately or without developed skill can certainly lead to problems. 

Withholding a click can lead to frustration if we don't, at the same time, set it up so that the animal makes a good guess as to what we're looking for in more behavior. It can also lead to an animal giving up because nothing seems to be working or they just can't get it right. More intense individuals may start throwing other behaviors at you in an attempt to get you to click something. For these reasons, we need to think carefully about how we are going to do this.

A key aspect to when you can withhold is the history of that behavior. If there is too little history, you have nothing to fall back on if the animal doesn’t understand. If you have spent a lot of time clicking for a behavior, then the animal thinks that behavior is good just as it is and also won’t understand if you stop clicking for it. Michele mentioned that handlers tend to fall into either side of this challenge: raising the criteria too fast, or staying at the same criteria too long. I know which I do and when!

She did say that if you use a well conceived training plan initially, and you want to change an established behavior, you can go back to an earlier stage and reestablish a history of clicks before withholding to ask for variety. 

One thing I see people do fairly frequently is to build duration into a behavior, and then if the behavior falls apart for some reason (possibly due to poor information during the shaping process), they try withholding a click, but the animal simply thinks it’s about duration so they don’t offer any changes. This leads to frustration on the parts of both learner and trainer.

In addition to the animal being sufficiently prepared to benefit from withholding, the trainer must have a plan. She listed four pieces. The first is anticipation of what the change will be (you should have your training session and environment set up so that you are pretty sure that your learner will offer what you want, rather than something in the other direction). You must then be prepared to click that! If you don’t really know what your learner will offer, it’s hard to catch the right effort that first time. You must also be ready to to back to clicking previous criteria if things start to go awry or else your moment of silence will extend into more than a moment and the accompanying frustration or giving up. And finally, know yourself. Is your tendency to ask for too much too soon? Or is it to allow the animal to get stuck by not inviting variety?


Something else she mentioned which I feel requires time for a trainer to develop is how to assess the animal’s response to withheld click. She said there can be “thinking moments” and she looks for the animal to remain engaged mentally, even if physically still. So if you withhold a click and your animal then looks off into the distance or frantically starts trying things, those aren't thinking moments. Then when your animal does offer something and you click it, does he offer that new variety again and does he offer it quickly? If so, he probably made a conscious decision about what to do and understood the new click. If not, it may have been a random movement and the click not understood by the animal. 



Saturday, March 26, 2016

Clicker Expo 2016 (Cincinnati)

my own neckpiece for the weekend included several species!
Clicker Expo can be many things to many people. Billed as the world's most innovative training conference, this year included training topics from many species. The main focus of the event is dog training, and dogs are the sole specie one is allowed to actually bring to the event. This year, for the first time, there was also a track devoted strictly to horse training. For horse people among us, this was long awaited and well attended. 
The opening talk by Ken Ramirez was about training butterflies, of all things. Watch the BBC for upcoming video of this amazing project.

Several of the talks which drew me in this year were actually directed at working with people: everything from Sustaining a Competitive Advantage in business (given by Aaron Clayton, president of Karen Pryor Clicker Training) to Critical Client Conversation Skills (given by the always entertaining and enlightening Dr. Susan Friedman of Behavior Works). I also attended one of several TAGteach presentations by Theresa McKeon on how to teach our human learners using the same basic principals we use teaching our animal learners.  Yet another human based talk I attended was "The Future is Now: Creating Powerful Trainer/Vet Client Teams" by Debbie Martin. All these just go to show that we can't help our animal learners without including the people associated with them.

Clicker Expo also advertises "training skills with cutting edge science" and if you want science, talks by Dr. Jesús Rosales Ruiz are the ones to attend! In the past, his talks have made my head hurt. He has a knack for putting behavior into algebraic equations and I struggled to keep up. This year I felt I was able to keep up with the entire talk, even when attending two of his back to back. "The Quadrant Quandary: Clarity and Perspective on an Icon" was the name of the first. In this talk he shared history of how the terms punishment and reinforcement, both positive and negative, came about. He spoke to whether these terms were defined in relation to process, procedure or stimuli. Looking up process vs procedure took me right down a rabbit hole but I think the point he was trying to make is that we need to be careful when we talk about the trainer "adding" or "removing" something compared to the behavior of the animal causing something to be added or removed. Additionally the notion that something is labeled as "aversive" or "appetitive" is completely dependent on multiple variables such as the learner, the environment, and the history. A longe whip might have an aversive effect on one individual and appetitive on another (such as my horse who loves the opportunity to take it out of my hands and play with it). For these reasons (among others), one needs to be very careful when labeling a trainer based on a photo or a video or a paragraph or an experience. Going back to Susan Friedman, it's best just to drop the labels altogether unless you have a very clear definition understood by all involved.

And that was just the first five slides of his presentation.

The second talk of Dr. Rosales-Ruiz which I attended was titled ""Fast Learner" The interplay between reinforcement rate and criteria". Again, he took some standard catch phrases and helped to me see them a little more carefully. "Raise the rate of reinforcement" is a common solution I give when people are having trouble training. It's a simple mantra, and often pertinent to people I am coaching who are new to training. But it is possible to bore a learner, to build in superstitious behaviors and to just get stuck by going too slowly. The takeaway here for me is to carefully assess criteria I am after and observe what is offered.   

More tomorrow. 

Sunday, February 21, 2016

Breakthrough

On our first evening at NEI, we went around the room with introductions. Steve asked us to briefly introduce ourselves with name, where we were from and what our goal was for the week. He also added the fun option of naming the superpower we would choose if we could have one or telling about our favorite scar. I cringed a little at the scar because I have a big one but I never would have called it a favorite. However, when I heard that Steve refers to scars as “badges of insensitivity”, I knew it was appropriate. My own scar is from being kicked by a horse and it certainly was due to insensitivity on my part. It wasn’t a training incident or some cowboy move I tried to pull, simply a situation that arose while doing chores at a job I had fresh out of college. I also heard a great story about one of Susan Friedman’s scars, though it had nothing to do with animal training.

I said my hope for the week was that working with a new and completely unfamiliar specie would help me think outside the box. When I went through the Karen Pryor Academy Certified Training Partner program, working that extensively with dogs really helped open my horizons to new ways to approach horse training. I was ready (or thought I was) to shake that up again.  

So when I found myself with a bird acting like a horse afraid to go near a trailer, I wanted to try the same methods. But Wouter knew I was there to learn something new and he gently redirected me, time and time again, to looking at things differently. I wanted to get the bird comfortable and relaxed; he wanted me to ignore that and focus on the behavior. An internal struggle ensued (in my head). I described it afterwards as having spent the first 2 1/2 days trying to put the bird in MY box, rather than being willing to step outside my box. I had little comparisons for everything from the cages being stalls and pastures to approaching that towel being just like putting a horse on a trailer. I have spent a lot of time in recent years taking the emotional signals of animals very seriously. After all, that was one of my favorite quotes of Susan’s: “Effectiveness is Not Enough”. Just because you can get the horse on the trailer or over the jump doesn’t mean it’s good training. I had new criteria and that was having the animal be comfortable and a willing partner through all training. It’s what choice was all about.

So when Wouter would point out the bird’s emotional signals and his “hesitancy” but at the same time kept me focusing “only on the behavior”, I was lost at sea. I struggled through that afternoon and it was late, late that night that I pulled out pen and notebook in my hotel room and the puzzle pieces started to fall into place. It all came back to the ABCs. 

antecedent -> behavior -> consequence

I’ve known the process for years, but being immersed, as we were, in Susan’s thorough coverage of boiling down complicated behaviors into the simplest form possible, I was able to shift gears. 

Previously, I had lumped physical behavior with emotional signals into the B of behavior. “Can you approach this scary tarp while keeping your head at wither’s height”. If so, then I determined that to mean the horse was “relaxed” enough to ask him to go a bit further. Wouter had me ignore the emotional signals as part of my criteria. If the bird moved, criteria was met, even if he then hastily retreated. The emotional signals the bird showed became, as I quoted Steve in a previous post, antecedents for the next behavior. It was part of the motivating operations. So I asked for less the next time, even if it meant we did not get as far. This was different from staying at one stage repeatedly until the animal’s emotional signals were showing comfort. I chalk this up to the capability of a horse being able to consume reinforcers for a long period of time compared to a bird who fills up in a matter of minutes. I’m not sure if that’s a fair analysis of the situation or not. I wanted to ask the bird to go to a certain point, reinforce, and then ask him to go back to a comfortable spot and do lots of easy behaviors to increase the ROR before asking him to approach the towel again. I’ve had great success with this tactic with horses. Wouter stressed that to do that would make the reinforcement history very strong at the starting point and that’s not where we wanted the reinforcement history to be. We wanted it closer to the towel. Either way, I had committed to letting go of what I wanted to do at this point and learning a new way. 

I targeted the bird toward the towel and watched the size and speed of the steps. If they were quick and large, I’d reinforce and ask for more. If they were small steps or latency between steps, I’d reinforce but not expect as much on my next request. There were many times when he’d get his reinforcer and then retreat. Previously I would have seen this as a failure in my training plan because I didn’t have the animal relaxed enough to stay. But I stayed with the new plan and we started making progress toward the towel. 

Wouter had a saying “the success is in the back end” which does correlate nicely with my horse training experience. The point is to observe where the animal retreats to, or is comfortable retreating to. Initially, this bird would hustle all the way back to the far end of the perch. As we progressed, he might still retreat quickly after getting his reinforcer but each time, he retreated less until he was retreating to points which had initially been difficult for him to even get to. 

The perch was a natural tree limb so I used the various knots and twists in it to mark how far we’d made it. Both the bird and I exhibited superstitious behaviors. There was one knot which seemed to function as a bit of a wall he had trouble passing (my superstitious assumption). When he did finally pass it, he did so by crossing his right foot over his left very slowly, rather than shuffling sideways. I immediately marked it, reinforced, and he shuffled his way quickly back down the perch. We did that again. Again, he changed his foot pattern when he got to that knot and again I reinforced because he made it past the knot. For the rest of our training days, he changed his foot pattern there, whether because it was easier or felt safer; or because I had reinforced it, I’ll never know.  

Carefully watching his feet- that is a good sized step!

This photo shows how close the bird was able to get to the towel at the end of several training sessions. At this point, both Wouter and I noticed that the bird seemed to shy away from my hand as I reached up to give the treat. I tried to move slowly and he hadn’t shown any concern previously so it was a puzzle until we both realized that it was my hand passing the towel that made him pull back. He was so worried (there I go again, talking about emotions), that my hand near the towel made him even more concerned. I tried touching the towel and then feeding but it was close to the end of the session so I only did a few reps.

The final morning we swapped the towel out for a washcloth to see if the smaller size would make a difference but it didn’t. I picked up the washcloth and tucked it into my sleeve with only a tiny piece (less than an inch) protruding in an effort to desensitize him. But when my hand approached to treat, he scampered away rather than taking it. I asked Wouter if he’d have that reaction if I just had a white shirt poking out of my sweatshirt and he said no. The bird had watched me tuck the washcloth up there, and he was not about to be tricked. 


The final afternoon we were all free to wander and watch each other train. Since the towel had been placed on the perch near the front of the cage, I did not feel that we would make any progress with all the activity near the towel (people walking back and forth). At that point, I took Wouter up on the offer to do some nail/claw trimming with the Dremel. Both the bird and I redeemed ourselves by progressing rapidly in this behavior. I started by capturing his foot on the wire, used the running Dremel as the cue for him to put his foot there and proceeded to buff each toe on the left foot, then the right. I’m sure he’d had it done before but Wouter said the Dremel as cue was probably new. In any case, it was a nice place to end our training. 


Saturday, February 20, 2016

NEI Training Projects

We were told we could pick any behavior to train for the remainder of the week. That was a bit of a challenge since I had no idea what one could train a bird to do! I decided to train a husbandry behavior and asked about nail trimming (I still don’t know if those are nails or claws or what on a bird). Wouter said that was pretty easy and suggested I do “toweling” and then maybe some nail trimming too. One of my teammates, Meg, who is a dog trainer, chose crate training. Birds are transported in crates just like dogs when they have to be moved, so it made sense to train a bird to be comfortable in one. My other two teammates, Tricia and Blake, both chose tricks. Tricia wanted to do something fun and also wanted help with her timing. She actually played with a couple fun behaviors over the week. Blake is a fish trainer at Disney and had been working on training a ray to swim out to a marker and back to him. He wanted a little help working through that process so he trained his bird to climb a rope up…and then come back down. The coming back down was the challenging part because birds like going up, and they want to keep going up to where there are some lovely high perches way up in the tops of the flights. So Blake got a lot of work with markers too, since that was how he  indicated to the bird “that’s far enough, now come back for your treat!”.

This shows the beginning of Blake's training for climbing the rope. You can see the bird trying to figure out how to climb this new thing (they climb up the cages and on the perches all the times) and how to find his balance by using his wings. Blake is marking and reinforcing the very first attempts as Wouter coaches.


I was lucky to get this early video and then on the last afternoon, I got another of the project as he was finishing it up. It's a great example of before and after of a nice training job.



So for those of us who had no idea what toweling is: birds are sometimes wrapped in towels for certain procedures to restrain them and protect the people working with them. Just as we teach horses and dogs to be comfortable with husbandry practices, birds can be trained to be more comfortable with the toweling procedure. A bird who has had an unpleasant experience with being wrapped up will be that much more uncomfortable and potentially difficult to work with in the future. To quote Steve Martin, “past consequences become current antecedents”.  Just how uncomfortable the towel could be was about to become very apparent to me. 

There are several methods trainers use to acclimate a bird to the toweling procedure. One which I saw done very successfully in the flight next to us, consisted of training a bird to go through a large (6-8”?) PVC pipe, maybe a foot long, by targeting him through gradually. When he was comfortable with that, a towel was laid over the pipe, just as environment. The next step was to have the towel hanging over the end of the pipe a little so the bird brushed it as he exited the pipe. This was gradually increased until the final behavior which I saw was a bird entering the pipe at one end and pushing his way out through towel which extended about foot beyond the end of the pipe. No human to bird contact was made the entire time so the bird was choosing to do this all on his own and becoming comfortable with the towel contact, the lack of visibility and the feeling of minor confinement.

There are times in our animal’s lives when we need to do something uncomfortable and we don’t have time to do the training ahead of time. I can tell a story to myself about how this must have been the case with the bird I worked with because we didn’t get anywhere near that progress. “Does why matter?” in relation to why an animal exhibits a particular behavior is a question that has dogged me for many years and I swing back and forth on the pendulum to answer it. Sometimes we don’t know our animals’ pasts, sometimes we do. How much does that matter in our training? Certainly if it helps pinpoint a particularly troublesome stimulus in an environment, we can focus in on desensitization with that stimulus. But during the week at NEI, Wouter repeatedly said to us, “doesn’t matter, this is about behavior”. Any time we slipped up and mentioned an emotion or a guess as to why a bird was doing something, the response was “doesn’t matter, focus on the behavior”. 

After initially observing the bird I was working with fly away rather than be on the table with the towel, we moved to a location with a high history of reinforcement: the long perch we’d worked on the previous day. The behavior I observed here was a hesitancy on the bird’s part to be within 8 feet of the towel, which we had folded narrowly on the far end to minimize the apparent size of it. I define hesitancy by comparing his response when I asked him to target toward my hand without the towel present to his behavior when I asked him to target toward my hand (between him and the towel) with the towel present. I could measure his hesitancy in both the size of the steps he took and the speed with which he took them. Without the towel, he would approach my target hand with steps measuring an inch or more each and in a steady rhythm of about 2 steps per second (I did not actually take this data; these are estimates). When the towel was present, his steps, when he took them at all, were about a quarter of an inch in size, barely enough room to put the next foot down and sometimes he only took one step before stopping or rapidly retreating.  

In our projects, we were always given choices along with great coaching. Wouter said I could try something else but this felt like something I should be able to accomplish. It didn’t seem any different than trying to get a horse into a trailer or to approach a scary object. I felt like I had the skills to achieve this and I said I didn’t care about the conclusion of the project (getting him under a towel); I wanted to work through it. 

Next up: Breakthrough

Thursday, February 18, 2016

NEI Workshop: Introductory Training

On the first day of the workshop, we were told to capture or shape three behaviors on our Macaw. This helped those of us who had minimal or no experience with birds get a feel for their offered behaviors, their style and speed of learning, learn a little about our individual bird and see what it felt like to feed a treat to a bird! I had zero experience with birds except for farm chickens. I was in awe. 

These first sessions were done in protected contact (meaning the bird was in a cage and we were outside it and feeding treats through the wire). I came to think of the enclosures the Macaws were in as comparable to horse keeping. There was a large “flight” they all shared, probably 20’ x 80’ and also 20’ or 30’ high. I thought of these as horse pastures. There were four or five birds “turned out” together when we weren’t training them.
Using his foot to hold the seed while eating

Inside that flight, there were a couple smaller cages probably 5’ by 5’ and 12’ high which were kind of like run in sheds. 2 or 3  birds were put in each to be out of the way when we were training. There was also a smaller cage on wheels, more stall sized, where the bird I worked with was put when others were training because “he didn’t play well with others”. He was out with all of them when we weren’t training, but the smaller confines must have brought out the same sort of behavior that one sees when horses are bunched together in a small area.

After that first protected contact session, we needed some more basics. Because we had not yet learned how to “lead” a bird (again, I revert to horse terminology), when we were ready to train out of protected contact, Wouter (pronounced Vowter) brought each bird out for us. The first afternoon he placed the birds onto a perch which was about eye level in the corner of the flight. The birds had the option to fly off into their “pasture” so it was only because they chose to stay that allowed us to work with them (and there were the occasional fly offs but not often and they came back pretty easily). We taught them to turn around on this perch and also to station on a piece of wood nailed to the perch. That became a high value place to be for the rest of the week. 

The next morning we learned how to cue the bird to fly to our hand and how to return them to the perch in a manner that they felt safe and comfortable. In Susan’s LLA class, she frequently uses the behavior of a bird “stepping up” onto a hand as an example. Last week the clarity of that term hit me. The birds truly do prefer stepping UP to stepping over or down. So when we returned a bird to a perch, we had to place the bird a little lower than the perch for him to be comfortable stepping up onto it, rather than dumping the bird out of our hands. We were taught to have them fly to our hands before stepping onto our hands because it’s easier for the bird.

Stepping up
Having the birds step up was an example of the choice that these birds are given. Traditionally, I guess people kind of press their hands into the birds chest to knock them off their balance so they have to step onto the hand. At NEI, the birds are offered a cue of right hand up which means the bird has a choice. If he chooses to step up, he picks his foot up in, I’m sorry but the cutest little darn posture you could ask for. It reminded me of a toddler reaching up a tiny hand in that trusting way that you will offer yours back to help them. In any case, when they pick up that foot, then you offer your left hand in front of them and they step on (and if you are Wouter, you accompany that offering with “did you call for an Uber?”).  

I had no idea what to expect when this bird flew to me but what I found was that he was very light (compared to a broiler chicken!) and the little feet are very gentle.  There were more mechanics to learn so we could turn this bird who was now facing us around so he could step back up onto the perch. All this needed to be done smoothly to keep the bird comfortable or he’d take to his wings. 


There was, of course, relationship to build. When I think of building a relationship with an animal, I tend to think of long term such as months at least. Here we were asking the birds to trust us in just a matter of days. I’m not a fan of flying myself, so it would have taken me a lot longer to trust someone if I was going to fly over and land on their hand. It also made me think about what we offer to an animal that we are asking to trust us. Certainly my teammates and I had the best of intentions for these birds. But we needed to quickly build our skills so we could offer clear communication in addition to our good intentions. This was obvious when comparing us to Wouter. He no longer worked at NEI and did not necessarily know these individual birds, but they responded to his cues quickly and comfortably. He had the body language, if you will, that they understood. I think that’s an important point to think about regardless of the animals we work with. So many people have great intentions with their animals but they just don’t have the education to understand that the human way they are communicating with them is not received with the emotion that it is given. Something as simple as stroking or patting may be done to an animal to convey appreciation or love, and yet it could be very aversive to the animal.
Next up: Training Projects

Wednesday, February 17, 2016

Natural Encounters Workshop 2016: Overview


Last week I attended the Natural Encounters Workshop in Winter Haven, Florida. It was a full five days of education with some wonderful instructors, headed up by Steve Martin and Dr. Susan Friedman. I had heard about the workshop while taking Susan’s Living and Learning with Animals (LLA) online course. I recommend that course and this workshop for anyone wishing to learn more about the science of behavior.

It’s always interesting to see how clinics and workshops are set up and experience different styles of teaching and presenting. I felt this workshop was a wonderful balance of lecture/presentation, demonstrations, sharing, and hands-on training. Attending any event which is based in positive reinforcement methods is a joy: Clicker Expo, clinics with Alexandra Kurland, and others really make one appreciate how different it feels to be with other positive reinforcement trainers. 

The daily schedule began with a wonderful spread of breakfast options with which to fill our plates before we sat down in the classroom. We were encouraged throughout to eat, drink and be merry. Steve is an amazing host who welcomed each of us onto his ranch, into his home, and into the lives and training of his birds. When telling anyone who I was going to be learning from, I would say, “Steve Martin, not the comedian”. But I have to revise that because Steve is not only warm and welcoming but pretty funny in his own right. 

After we had our breakfast and coffee laid out around our notebooks (fat binders we were handed on arrival with printouts of all power point slides as well as a resource section), either Susan or Steve would present a power point. Susan’s were as meaty as in her LLA course; they were filled with gem quotes, thought provoking slides, and video clips to illustrate various points. This was my third time hearing some of this information (having taken advantage of the opportunity to re-take the LLA course for free after the first time through) but I still found myself listening intently, scribbling notes, and having new “ahas”.  

Steve’s presentations included amazing videos, slides and stories of training animals all over the world. He’s been a consultant for zoos on many continents, travels regularly for enjoyment and photography (Africa and the Far East to name a few places), and has influenced the lives of many animals for the better. He has watched the evolution of training over the decades and is a treasure trove of training history up to the present moment as Natural Encounters has shows at Disney World and two (I believe) that travel around the country. He is dedicated to the absolute best welfare that he and his trainers and staff can provide. 

After the morning presentation, Steve would outline our training plans for the day. We were broken down into teams for the week of four participants assigned to a team leader, most of whom were NEI trainers. The participants were a wonderful blend of zookeepers, animal trainers (including dog trainers), companion bird owners, and other professionals. If you think Disney World is all about Mickey Mouse and the rides, let me tell you there is a whole subculture of incredible animal trainers as well.  I considered myself very fortunate to have Wouter Stellaard as team leader. Currently the head trainer at Columbus Zoo, Wouter had previously been a trainer and VP at NEI. He was an excellent coach with a wonderful sense of humor. 

When we headed to the birds, Steve began by demonstrating our training plan for that session. We had each been assigned a Macaw to train for the week, and each team had been assigned a Corvid. After watching the demonstration we broke into our teams and moved on to our own birds, taking turns with the Corvid day to day, and taking turns with our team leader’s attention with our Macaws. 

After the morning training, we returned to the classroom for a hearty lunch and a few minutes to share stories with each other. The afternoon repeated the morning schedule of lecture, demo and training. Each day ended with more food (this time crackers and cheese and vegetables and more, along with quite a variety of wine, beer and other beverages) and a “talk down” where participants and team leaders alike shared thoughts from their day. All the team leaders were confident, friendly and encouraging which I believe is a testament to Steve’s work. 
next up: Introductory Training
Viper, the Pied Crow our team worked with