Thursday, January 26, 2017

Naughty Horse Part 3: The Inconclusive Conclusion

horse tracking
The morning after that escape, I followed Percy's tracks backwards from the pony pen. As I mentioned earlier, I have a track which goes around the arena. There is pasture surrounding the arena so this track allows me to open up various parts of the pasture for grazing. I had placed the jumps for the jumping lane on the eastern side of the track, as that side is used if the track is used at all. The southern and western sides of the track only give access to the small pasture along the road so they aren't in that part as often. For the winter, I remove the eastern track fence so they have access to the entire field. I then put a short piece of electric rope across the opening to the southern and western track to keep them out of it entirely. Yet this is where Percy's tracks led. 

When I got to the rope closing off that portion of track, I discovered that the increasing depth of snow had left the rope only about 18' above the snow. The tracks indicated that Percy had jumped over it, possibly from a standstill. The tracks went right up to the rope on the takeoff side, but didn't begin until about 4 feet out on the landing side. He might have walked up to it in order to assess it and then backed up to trot up and jump as I have seen him do. I'll never know. 

I had swapped out my yak tracks for snowshoes when I climbed out of the plowed barnyard into the track and now I maneuvered them carefully over the rope. One end of the rope was attached to an insulator which was then attached to an arena post by wire. I had not turned the fence off before coming out. In the summer, it would have been a quick walk back to the barn to do so, but when snowshoes and yak tracks are both required, I decided to do what I could in the moment. I pulled off my gloves and slowly worked the wire up the post, being careful not to let the hot rope touch the insulator wire. I doubted there was much tingle in it this time of year but I didn't want to find out. I raised it until the rope was at my waist height. Since I was on snowshoes, Percy's weight to surface area ratio on hooves was going to put him deeper in the snow. And yes, I crossed my fingers and went in the house.

All was peaceful for a few days. I was careful to put hay out far from his new escape area and plenty of it. I made sure I was not late for chore time. Any time my obligations kept me from being home on time, I confined everyone to the small sacrifice area near the barn. I hated to do it, but I also didn't want to come home to find horses out everywhere. So far I'd been lucky that no one else was following Percy out. They must have decided he had some kind of magical power. Ande and Stowaway had both been doing the jumping lane every time Percy did and Ande had done plenty of free jumping in the arena as well. But thankfully, they did not use their skills the way Percy did. 

Then one morning I had to leave very early. I committed the cardinal sin of putting horses out with hay and water but not cleaning stalls. I really, really hate leaving stalls dirty but just did not have time that morning. I love surveying a nice clean barn before I walk out of it, knowing that it has hours to air out before horses go back in. To add insult, I forgot they weren't clean until I went out for afternoon chores. Ugh. Shortly after I started in on cleaning Percy's stall I heard a commotion outside. When I opened the aisle door, there was Percy. It was clear by the tracks in the dusting of snow that the commotion was him falling on the ice. Interestingly, the UPS man was also out there. I'm not sure who was more surprised but Percy and the UPS man were both wide eyed and staring at the other. I calmly took the package from the UPS man while Percy trotted around the barnyard on the ice with his tail up over his back. I waited until the UPS truck had left and  took the time to observe that Percy didn't seem to have any ill effects from falling on the ice. Then I called him, all the while thinking:

behavior which is repeated has been reinforced

I decided that being allowed to play in the barn while I prepped stalls the other evening had encouraged him to jump out again and come to the door. I didn't want to strengthen that habit, plus I still had two dirty stalls to clean. Had I been a good girl and done the stalls earlier, I could have put everyone in and prepped stalls around them but I didn't want to put them in dirty stalls. Instead, I opened the gate and put Percy back in with the others where they were waiting for me to finish chores. He did get a treat for going in. I thought perhaps falling on the ice might function as a punisher completely unrelated to me and make him think twice before going that route again. And he wasn't going to get to play in the barn this time.

I had moved on to the next stall when I heard footsteps crunching in the snow again. I swore, went to the aisle door, opened it and stepped out. This time Percy trotted right past me and out to the driveway and around the barn. That answered that. Being put back in paddock with no fun was more closely related to coming to me, than it was to jumping out. Putting him back had served to punish his voluntary recall. I swore again and followed him into the dark. 

It was when I saw him scamper around to the other side of the barn that I had to really stop and wonder just how calculating he was. I had dropped a bale of hay out the loft door on the east side of the barn into the snow in preparation for the following morning. Percy made a beeline for it. Had he seen me do that and figured out that's where he was going from the start? He had left the other ponies in the shed, crossed the sacrifice paddock, gone all the way down around the full length of the arena, in the dark. On a warm summer day in bright daylight, there are sometimes monsters at the far end of the arena. Apparently monsters hibernate in winter. Or don't come out in the dark (which is not the way I remember it from my childhood). In any case, he'd circumvented the entire arena, slid his way across the icy barnyard, out into the driveway, down the length of the barn and around to the far end where the hay bale was. 

taken looking out the window with the aisle lights reflecting
Once again, I found myself at "now what?". This horse is exhausting. Stalls still weren't clean. I couldn't put him in his stall (the one clean one) because he would be unhappy alone in the barn. There was no point in putting him back with the others as I'd seen how well that didn't work. I left him where he was, tearing at the hay bale. I thought he might decide to come back on his own but each time I peered out the window, he was happily wrestling with the hay bale. 

When the barn was finally ready, I went out to him. I was cursing myself for not keeping the eastern doors to the aisle shoveled out. I hardly ever open those doors in the winter and had let the snow pile up against them. It would have been so much easier to open them, right where he was, and bring him in from there. Instead I had to walk around on the ice. Normally he would happily leave a bale of hay to come to me (after all, he left all that lush grass in the summer to trot up to me after escaping), but I had to remember how I had "punished" him by putting him back with the others the last time I caught him. I had to walk up to him and it took a little convincing, but with a decent rate of reinforcement every few steps, he came along. I hadn't even taken a halter with me because I needed to force myself to correct my previous errors, not create more by taking away his choices. 

 When I followed his tracks backward the following morning, I discovered my rope gate had been taken down entirely. The insulator wire I had so carefully pulled to the top of the post, he had lifted right off the top and it lay in the snow. I'm not sure whether he did that the first time or the second, but I replaced it, and tightened it all up so that it would not be so easy to lift off. 

He's far from secure. I continue to feed generous amounts of hay (so that the ponies turned out with him are about to pop even though they get a scant fraction of what he does when they are inside). I make sure I am on time for chores. If there is any chance that I won't be home from training others at the appropriate time, I confine them to the sacrifice paddock. 

Current reinforcers for jumping out include:
  1. hay
  2. adventure
  3. interaction
  4. treats

In effort to find ways to reinforce him for What I Want (always where we should start with any training plan), I have wondered how I can use those same reinforcers to keep him in. The hay I am already doing. What I am working on is ways to use adventure, interaction and treats to encourage him to wait in the sacrifice paddock for me to come to him, rather than having him come to me by jumping out.

I am going out for chores early. Forgive me for whining but training here this time of year is not fun when it involves freezing hands. But we are having mild weather in the 20s and 30s so I'll do something with him, whether it's husbandry practice or games or letting him play in the barn, as long as he is in the paddock when I go out for chores! I'll also let him adventure a little as long as the ice isn't too bad. We're expecting several more inches of snow tomorrow. If it's the kind that sticks to the ice and improves the footing, we'll go out and play in the driveway together.

And I'm counting the days until Spring.

Tuesday, January 24, 2017

The Naughty Horse Part 2 in Which Reinforcers and Punishers Are Analyzed

So now I had a horse who was jumping out of of his paddock whenever he wanted. If they had been given a new section of grass, which happened every day or two, he was happy to stay and eat. It didn't take long for "the grass is always greener on the other side of the fence" to set in and he'd hop out. There was a particular strip of grass near the house that was incredibly thick and lush. It's where the runoff from the barn paddock occurred, so it was heavily fertilized. That is where he would go to as soon as he was out. It was conveniently located beneath the house window and so I knew as soon as he had escaped. This only occurred a few times over a day or two while I wracked my brain for a solution. 

I raised the fence as high as I could without risking the ponies escaping underneath it. Scaling height was not a problem. Giving him fresh grass only kept him busy for part of a day. Finally, I took a chance and relocated their grazing to the far end of the field. It meant giving up on a section of grass I really wanted them to clean up, but I started them over on regrowth as far away from the tempting spot as possible. I also left in place the border fences of the paddock they had been, so that he would have had to jump three fences and go a distance from his buddies to return to his desired grazing. That did the trick. I was on overwatch for several days before I could relax, while realizing that it was only a short term solution.

At this point I had:

  • unwanted behavior- leaving a chosen confined space by jumping a single strand of electric rope over 3' high (with only 15' of approach as that was the width of the grazing strips)
  • reinforcer- lush grass
I had to set it up instead as:
  • desired behavior- remaining in specified paddock
  • reinforcer- lush grass
  • making the unwanted behavior less desirable by 
    • adding distance to the previous reinforcer
    • adding more fences between him and the previous reinforcer
    • no reinforcement available for jumping the first fence (which put him in grass that had already been grazed down)
Problem solved. Temporarily. As summer turned to fall, I was careful in how I arranged paddocks and that he had plenty to eat each day so that we did not experience a resurgence of the jumping. He was eventually turned into the paddock with the lush grass and given free access to it. 

That solution lasted until all the fall grazing was gone. Once the good grass had been eaten from the rotational grazing, I opened the paddocks up to larger and larger spaces so that they could forage for spots they'd either missed or been too fussy for previously. They get a lot less fussy as the fresh grass stops growing. They soon had the entire field to play in and hunt around in. Which is when Percy realized that the hayfield which hadn't been mown since the end of summer had regrowth far better than what was in their pasture. And he jumped out again. 

At this time of year I had to realize that there was nothing I could give him as a reinforcer inside the pasture which could compete with the grass he was finding in the hayfield just on the other side of the fence. I could have made it harder for him by increasing the height of the fence, but that meant I would have also had to add an additional strand to the bottom for the ponies. I knew once we got snow that would just be buried and cause more problems. Hay kept him happy short term but before it was even cleaned up, he chose to jump out for dead grass on the stem over dead grass from a bale. 

I had to confine them to the paddock near the barn, as much as I hated to do so. Snow came and covered all the reinforcing grass. I gave it another try. He wasn't that easily discouraged. Whether he remembered, could smell it, or just took a chance, he jumped out and was soon digging through the snow for the grass underneath. 

This brings me to the other reinforcers for jumping out. Me. Leaving him loose just increased the value of jumping out. But preventing that by going out to retrieve him was also reinforcing. He'd hear the door open, pick up his head, and trot right to me. At that point I could have put a halter on him and returned him to his confinement...but that would have been connected more closely to being caught than to jumping out. Had I done that more than a time or two, he wouldn't be so foolish as to be caught. So yes, I offered him a peppermint or a piece of apple and he happily followed me to the barn, sans halter. We'd play a bit together before I put him out with hay (to bring the other horses back in) and I'd close the gate to eliminate access to jumpable fences. 

Finally we had enough snow that I thought he might think twice before trying to jump in the deep stuff. I put hay out far from the house (interestingly, he never tried to jump out from any other part of the fence) and after several days was relieved to see him staying in. Well, except for the days I was a little late getting out for chores in which case I'd look out the window to see him using teeth and neck to dislodge the fence posts so he could step out. And yes, he'd watch the window for me as he did it. There are advantages to being a reinforcer oneself, but sometimes disadvantages. 

Last week (we've made it to the middle of January), I was a little late writing up some behavioral follow ups for clients and it was dusk by the time I left the house to do afternoon chores. I hadn't seen him playing with the fence post so I was concerned when I only saw four, not five, equine figures waiting for me. I squinted. All I could see were white markings in the dusk. Rumer's paint body was easy to see, and Kizzy's blaze and even Ande's strip were there. Stowaway's spotted rump was visible. But no big blaze and stockings. Where the...

For the first time I hoped he had finally figured out how to do the snap combination on the barn doors and had gotten in there but when I hurried into the barn, no Percy. No one seemed upset so I couldn't believe he'd gone far and only hoped he wasn't lying out in the field with a broken leg. I dashed down the aisle to the far end of the barn and slid open the doors. 

Through the dark I saw him in the pony pen. The gate was wide open and he stood looking at me interestedly. 
"What are you doing out THERE?", I asked. 

Once again, I was faced with what to do now. I felt I had to reinforce him for coming to me, especially since it was dark and cold and he was oh-so-willing. I did not click and treat, but simply let him follow me into the barn and closed the doors behind him. I knew that being locked in his stall would feel punishing, when the others were still outside. Instead, I let him do one of his favorite things which was to explore the barn while I prepped stalls for the night. He wandered in and out of the different stalls, took a bite of a hay bale in the wash stall, poked his nose in places that interested him, and generally behaved like a dog until I had all the stalls ready. Then I put him in his own stall and quickly brought the others in. 

Did this reinforce his coming to me? Did it reinforce the fence escaping? There would be no way to know until I saw what he did next time. 

To Be Continued!

Thursday, January 19, 2017

Real Life Reinforcers, Punishers and a Story of a "Naughty" Horse

The naughty horse in this story is my own and I take full responsibility, as I must, for his behavior. "Naughty" is just one of many adjectives we hear when describe animals. Stubborn, willful, spoiled and even arrogant are just a few others. The more we learn about behavior, the less we need these labels, although I still need to stop myself from using them occasionally.

If I were to replace "naughty" with kinder and possibly more helpful descriptors, I'd say he's a good problem solver. The challenge is that that we have different ideas about which things are problems and which are solutions. I consider fences to be a solution to the problem of having a horse somewhere I consider unsafe: in the road, on bad footing, eating pasture too lush for his digestive system. He considers fences a problem to be solved so that he can eat tastier grass and explore places. I consider his penchant for escaping to be a problem. And around we go.

I do have one fence which contains him. It's a five foot high woven wire fence on solid posts set well into the ground and topped with one strand of electric. I don't like to keep him there because it's a small area and one I feel badly about confining him to. Also, if I confine him, I must confine everyone so they each have access to shelter and water.

The larger pastures are fenced with electric rope. That is sufficient for everyone else, as long as I make sure that the fence is on, no wildlife has gone through it, the height is appropriate for the individuals confined, and other basic maintenance.

Before last summer, that at least functioned to keep Percy (aka "naughty horse") in as long as there was grass to eat, which, after all, is a horse's natural behavior. Giving an animal appropriate natural behaviors and fulfilling their natural requirements of food, water, companionship and shelter goes a long way toward keeping the peace.

Previously he had several ways of conquering the fence problem. When he got bored in the winter he would play with the fence posts, taking them in his teeth and pulling them out if he could. If not, he'd rub his neck gently on them until they loosened and tipped. While playing with them, he'd discover that in the winter, the fence wasn't as "hot" as in the summer. With the earth solidly frozen, there was no moisture to provide a "ground" for the electricity to go to, and the little tingle it gave off didn't deter him from playing with the rope itself, sliding insulators up and down and removing them entirely with his clever lips.

As if that wasn't enough, last summer I taught him how to jump out.

That wasn't my intention of course. With my history in eventing, I know that a horse can learn how to use his body over fences best without being encumbered by a rider. One can build a jumping lane of fences and chase the horse down through it so that he jumps the fences in his way and practices his gymnastics. Because it involves chasing, I came up with a reason for the horses to want to jump through, rather than needing to chase them through. I already had a lane for them to go out to pasture and back, so I simply starting placing things in their way. First it was a rail, then a couple, then a small jump, then a couple, etc. I've been working up to larger jumps over the past couple years and pleased to see them each becoming more and more comfortable. They seem to enjoy it and I don't leave the larger jumps up for them to need to do multiple times a day. I usually set them up for them to go over on their way out, then lower them to smaller obstacles for their trips back and forth. Percy showed a knack for clearing the jumps I set.

step one of teaching Percy to jump out
I also taught him to jump in a more thoughtful and controlled manner by doing some agility with him. A somewhat new sport with varying levels of contact and liberty work, it was the theme of the August clinic I hosted last summer, along with Katie Bartlett, Cindy Martin and Marla Foreman. So I spent the earlier part of the summer playing with Percy on the various obstacles to become acquainted with them: a tractor tire filled with sand, weave poles, hula hoops to station in, etc. Oh, and little jumps. While all the horses and ponies liked to race out through the lane to pasture, Percy took a much more casual approach to our agility jumping. He really didn't think he should get ahead of me and I can't go as fast as he does so he learned to jog up to jumps carefully and hop over them, not leaving me too far behind. That, apparently, was phase two of teaching him to jump out.

The first time I looked out to see him grazing, alone, in some deep and lush clover on the opposite side of the fence from the others, I searched to see where the fence was down. It wasn't. No one else was out. I thought he must have been reaching underneath the fence to graze, and mistakenly pushed through it, somehow allowing it to spring back. I put him back with the others, checked to make sure the fence was on and watched from the barn.

He trotted down to the narrow strip of grazing they have each day and walked carefully up to the fence and reached out to test the fence with his whiskers (this is how he assesses whether it's on or not). I saw him pull back quickly and then buck several times in place. Aha, I thought, now he won't try anything again. But then he backed up about four steps, did a lovely little lift of his forehand off the ground, trotted forward...and jumped the rope.

I won't tell you what I said.

So that's the background for this past week's tales of naughty.

To Be Continued

Saturday, December 31, 2016

Hay Net, Bag, Feeder Review

Hay pillows in front.
Busy Horse feeders in rear

This year I'm trying some new hay pillows. It's not because I'm unhappy with the Busy Horse hay feeders I have. Quite the opposite. I am really impressed with the Busy Grande regular feeders that I have had for many years. In the winter they get almost daily use and they are holding up beautifully. I have three of the Busy Grande hay feeders which are big enough to stuff two or three good sized flakes of hay into and have holes that are about 2 1/4" square. I also have one of the Busy Grande Slow Feeders. They hold the same amount but the holes are only 1 3/4" square. The horses definitely prefer the bigger holes, and choose those bags over the other, such that I have designed a system as to where I put the one with the smaller holes. 
the Slow on the left and the Regular on the right
For the past several years, I've had four places that I can hang the bags. Originally, my husband put four posts in for me but Kizzy snapped one right in half rubbing on it the year she got Sweet Itch so badly. And then we got the street sweeper for itching on and it was convenient to slide that down over another post. Which left me with two posts. The other two heavy duty screw eyes are in the shed attached to the barn. 
The shed is only two sided, and if the wind/snow/yuck comes out of the south, the warmest driest spot is on the western side of the shed. So that is where I put the bag with the smallest holes. My reasoning: whoever has to struggle with that bag, at least is in a cozy spot to do so. Whoever is out in the wind and the snow, can at least eat more in less time.


Stowaway got the slow one in the shed here. You can see how he works at it.
Let me back up a little as to why I use hay bags at all. I do believe that horses should do a lot of eating off the ground. Studies have shown that their nasal passages drain well that way and it helps prevent respiratory problems. However, the studies I am aware of were done ages ago and compared eating off the ground to eating out of hay racks or bags mounted high on the walls of their stalls. 

One of the reasons I chose the Busy Horse bags are because they have no strings to get
The heavy duty snaps I use...double ended ones just broke.
tangled in horse legs. They have two rings in the top which I use heavy duty snaps to attach to heavy duty screw eyes in posts or walls. My horses are all barefoot and so with no strings and no shoes, I am comfortable hanging these bags low enough so that the bottoms are at ground level once the snow comes. The one in the video above is higher, but I'm ok with that since the horses rotate from one to another. They spend some time with their heads at all heights. 
Horses are also browsers of leaves and brush, so eating at higher heights is not completely unnatural. If I only had one horse and one hay bag that horse ate all her meals out of, I'd be more concerned about the neck issues that some people worry about.

So why not just feed on the ground? I do, in the morning, when the weather allows. As long as it's not too windy, I spread one bale of hay out in the large field before I turn them out each morning. I spread the sections far apart so they have to walk a lot to get from one to another. However, there are some mornings that it is so windy that the hay blows away before it hits the ground, to say nothing of before the horses can clean it up. I don't like using good hay to mulch the next field over while my horses go hungry. So the hay bags keep the hay in place long enough for them to consume it!

It also keeps the horses busy longer. This morning I put a bale out in the field and they had finished it before I left the barn an hour and a half later. I then put another bale in the 4 hay bags and 2 hay pillows. Four hours later they are still picking at those: much better for the equine digestive system.

Finally, it's nice for my schedule to be able to fill the bags at morning chores, and then just hang them, not far from the barn, whenever I get a chance to during the day. It's much easier than putting another bale on the sled and having to hike out to the field while the hungry and bored horses are trying to pull hay off it. They can exhibit self control long enough for me to get a bag hung up. 

Note: Back when Mariah was here, she was big enough and clever enough that she'd stuff her nose down into the bag from the top, eliminating the "slow" from the equation. It was quite tedious, but I had to weave them closed with bale string each time to prevent her from doing that. 

And that brings me back to the hay pillows. They are designed to be thrown right on the ground which is more like grazing. I think I initially got them for the ponies when they are in their own round pen. I have other nets I hang for them but I didn't like doing it all the time. With no posts in their pen, I could just fill the pillows and throw them in. 

When they first arrived, I was disappointed. I thought there was no way that the zippers which held them closed would hold up to the job. In addition, the reality of the filth they could be in on the ground was disheartening. No matter how clean the pen was when I put them in, by the end of the day, there would be manure at the very least for them to be dragged through. If the ground was at all muddy, the bags would be too and if they got flipped over, yuck. A time or two they were so gross at the end of the day that I needed to hose them down and hang them to dry before I could use them again. They were hard to find, being brown, they were camouflaged into the brown muck. Then when freezing weather came, they froze into nasty smelly things so I quit using them. 
Hay Pillow zippers encased in snow
But when winter came, I decided to try again. And I'm amazed how well they are working. The ground is clean and snow covered (we get fresh snow quite regularly) so they stay clean. The zippers continue to work even when full of snow at single digit temps when being tugged on by my gloved fingers. They are frozen into shape when I bring them in at night, but 12 hours hanging in the wash stall with the horses warming the space thaws them enough that while they are still snowy and a little stiff, I can open them and re-stuff them the next morning. 

One of the greatest things about them is how easy they are to throw over a fence, without losing half of it to the wind! Admittedly, they are not used every day, and we are still in December (one more day!) of the first winter. So I cannot say that they will last as long as the others. The ones I got don't hold as much and they were close to the same price. But they do give me options so we'll see how they hold up. The horses do paw at them and flip them around a lot...part of the fun. 

This fall my husband put four new posts out in the field for me for those mornings when it's really windy AND I won't be home at noon. I've ordered more of the Busy Horse Grandes so I will be able to hang eight out in the morning which should keep everyone busy for the day!

Friday, December 23, 2016

12 Days of Christmas

In my recent blog for the dog training part of my business,  
swollen eye
( I linked to a 12 Days of Christmas training series by Donna Hill. I also mentioned that working on husbandry skills is a great winter project. Since then I have been keeping a list of skills to see if I could come up with twelve for my own 12 days of Christmas project. 

Here is my list:

  1. deworming
  2. foot handling for simple picking as well as for trimming
  3. intramuscular injections
  4. intravenous injections or draws
  5. eye care
  6. ear handling
  7. leg palpation
  8. leg manipulation
  9. TPR (taking temperature, pulse and respiration)
  10. bandaging or applying boots
  11. tooth care
  12. sheath and udder care
wearing boots (NOT put on correctly)
I'll focus on each one of these per day, as both a review of how our skills are, and looking for ways to improve them. Each one can be incorporated into a daily grooming session or chore time.

As always, it's important to work on these before you need them. An injured horse does not need added stress of treatment and handling she has never received before. A professional (chiropractor, vet, hoof trimmer) does not need the added stress of working on a horse who is not familiar with what is being done!

Sunday, May 15, 2016

Bitless? My Thoughts on the Wide Range of What Is Acceptable to Different Trainers

Myler Level 1 Loose RingAll one has to do is pick up a hefty tack shop catalog to see the enormous variety of equipment available for working with horses. Or visit the website. Some of the equipment looks like medieval torture devices to me. But some of the equipment I use, like a plain snaffle bit, apparently looks like a torture device to others. 

"Pressure" is a loaded word in horse training circles. There are those who say it's the most natural way to train horses (a la "Natural Horsemanship"). There are others, like myself, who have found that using Positive Reinforcement instead of escalating pressure to train is a highly effective method which is also more humane. But the continuum continues. There are those who think that what I consider a "contact" cue is really pressure. They want to hang me by my toenails, even though I teach contact cues with positive reinforcement, rather than escalating pressure (and the irony of the highly aversive words and deeds these individuals bestow on fellow humans does not escape me).

Pressure is not just physical. As soon as an animal perceives your presence, there is pressure. And pressure can be a pull as well as a push; just ask anyone who has livestock..."pressure" will pull animals to a barn, to grass, up a hill, to a larger group, etc. 

So where do each of us draw our lines as to what is acceptable and what is not? 

If we start with truly wild horses, those who have never seen people (wow, is that even possible today?), then they experience pressure from humans miles away. Horses are horizon scanners; just ask mine. A person appearing in the distance is noticed. The horse is already considering its flight options. So, for those who don't want ANY AVERSIVES used in training, I would propose you leave them wild. Because your presence is initially aversive. 

Maybe you say I'm talking nonsense when I start with wild horses. So start with a newborn foal from a very domesticated line of horses. I posit that your first appearance will be aversive to that foal. Is that reason not to enter the stall? How are you going to train that foal if you don't get that foal accustomed to your presence? You may do it carefully, gently, with scratches (oh, but don't they twitch at that first touch of a human hand) on the chest and withers. But you have applied your hand to that foal, or mustang, or any other equine. That's contact. 

Where does contact cross the line to pressure? Is it a pounds per square inch measurement? Does it depend on the body part? Is a massage aversive? The answer is, as we so often say, "it depends". The type of deep tissue massage my husband likes makes me miserable. Everyone has different sensitivities. So we need to assess the individual at hand. 

Is pressure defined as aversive if the horse moves away from it? How do these folks who claim not to use pressure ever ask a horse to step away from them? I train a horse, using positive reinforcement, to step away by reinforcing the slightest movement away from my hand. Yes, if I can detect the movement away, I click and reinforce. Animals move. Even when they look like they are still, they move slightly, shifting weight. I can capture that little move when it happens away from me, and I can click and reinforce and my educated learners will repeat that. They will do it again, and I can shape more or less movement. So yes, my horses move away when I put up a hand in a certain way, but it is not because I have used escalating pressure (escalating pressure would be if I put my hand on the horse and intentionally added more and more pounds to my pressure until I got a reaction. Or if I got louder with my voice until I got a reaction. Or I kept kicking or pulling until I got a reaction).

So, in my life, I now have a horse who will move away from me on the cue of my using my hand in a certain way. I trained it using positive reinforcement, not escalating pressure. But because the horse moves away from it, do others consider it aversive? I don't think that assessment can be made unless you know how it was trained. 

How would we put any equipment on a horse if we never used contact/pressure? I would say the ethology of the horse does not include wearing a halter, or a blanket, or a cordeo (neck rope). Therefore, if we put any of these things on a horse, we are applying something inherently aversive. When I do this, I initially click and reinforce for any interest (looking at, sniffing, touching) the object. Once they make voluntary physical contact with the object, I can progress to touching them with it, gradually, and with reinforcement for every approximation along the way. The formerly aversive object is no longer something they move away from. In time, I can help them become comfortable with that object. Why would I do that? Because I feel that there are times when halters and blankets help keep horses safe and comfortable.

And what about riding a horse? Well if we look at the painting below and read a little about equine predators, it isn't too big a stretch to know that the "natural" horse might consider other creatures on his back to be quite aversive.

So we train. There are many, many, many steps I take to help the horse be comfortable with having first my hand, then a brush, then a pad, then a blanket, then a saddle on her back before I stand above her on a mounting block and lean over, lean on, put a leg over, rest on and finally sit on a horse. 

If one doesn't believe in desensitizing or counter conditioning a horse to inherently aversive stimuli, how does one ever get to the point of riding a horse? 

Note! Desensitization as I refer to it means working under threshold; one exposes a horse to potentially aversive stimuli in an incremental progression so they are not stressed. "Sacking out" in a traditional method is not desensitization; it's called flooding. 
Counter conditioning is when you take a stimulus which was formerly aversive and change the response to a pleasant one. An example would be the halter which was initially aversive to a young foal can be conditioned to be a sign of an enjoyable training session with treats. (some say that the item must formerly have been conditioned to be aversive. I'm not clear on that.)
And this brings us to cordeos vs. bridles vs. bits.  If we put a rope around a horse's neck and a halter on her head, why not put a bridle on her head? I am going to assume we all know the proper fit for said pieces of equipment, including the sensitive areas (where the nerves run) of the face and that we are not using nosebands to tie the mouth shut, etc. I'm also going to assume that we all know that some of the bitless bridles are much, much harsher than a snaffle bit. Poll pressure and nose pressure can be quite aversive to horses and many of the bitless bridles are designed to exert a lot of pressure on these areas with very little pressure applied to the reins. Novices beware. I've also heard that some of the pretty little neck ropes include barbs. Nuff said. Looks can be deceiving. Oh and that a properly fitted bit hangs in the horses mouth, not resting on the bars. It should not interfere with chewing or physiology of the teeth, bars and tongue. 

If the above are true, can we not help a horse be as comfortable with a bit as with a blanket? If we train the contact cue from a bit/rein combination with positive reinforcement, can it not be an effective and kind way to communicate with the horse? A bit offers subtlety of communication that can be difficult to achieve with a loose fitting halter or bitless bridle. Loose fitting means it can move around. That can be more aversive to a horse than a securely fitted bridle which stays out of eyes and minimizes chafing from the movement. 

I think the final question which remains is why? Why do we use any of this? Why do we have a domesticated horse (or 2 or 6) in our lives? Why do we want to train them at all as opposed to having pasture pets? Why on earth do we want to sit on their backs?

In the Introduction to Animal Training, by Ken Ramirez, he states:
As teachers or trainers, we must know why we are training...important reasons for training are those that directly benefit the animal being trained. 
He lists the primary reasons for training an animal are to benefit its physical exercise, mental stimulation, and cooperative behavior (husbandry skills to keep the animal healthy). I think if we start there, we can also end there. 

Thursday, April 7, 2016

Jackpots and High Value Reinforcers: Riding the Swing of the Pendulum

When I first started clicker training over 15 years ago, jackpots were somewhat popular. Examples of jackpots were a larger number of treats or a special treat. Since my standard treat was 2 hay stretcher pellets, the jackpots I used were a full handful of pellets, a couple peppermint horse treats or a human peppermint candy. My horses really like the peppermint horse treats and loved the candy. Sometimes I also used cut up carrots or apples, but I liked being able to keep the peppermints on hand when the carrots and apples didn’t keep well in my pocket. 

The way I understood their use was that when the horse offered extra effort, you could give a jackpot to communicate that was a really good try. Over time, however, jackpots fell out of favor. A study done with dogs and conducted by Dr. Jesus Rosales Ruiz and his grad students indicated that jackpots interrupted the flow of training, thereby actually slowing training, rather than aiding it. I could understand how this could be, as my horses savored the peppermints to say nothing of the time it took me to unwrap the candies. I felt badly fading them out at first, but over time, found that my horses worked just fine for the hay stretcher pellets alone. I stopped using the peppermints...well, except for one particular learner on which they continue to be very effective, that being my husband.

Several years later, I took Susan Garrett’s Recallers course for dogs. I did the course both with a horse and dogs. Susan
speedy recalls: a result of high value reinforcers and slow progression
stresses knowing what your dogs consider to be high value reinforcers and using them carefully, but definitely using them. So back I went into experimentation mode. Susan’s course helped me understand a different way of using them. Rather than using them to point out good effort in shaping, she used higher value treats as a balance to distractions. The world is a fascinating place to dogs and in order to gain and keep the dog’s attention, we used cheese, hot dogs, tuna fudge and other delectable items to reinforce the dog for doing what we asked, as opposed to sniffing in the grass or leaving to say hi to the neighbor.

This is when I developed my own foundational concept that while for dogs, distractions are usually things they want to get TO; for horses, distractions are usually things they want to get AWAY FROM. Yes, this is a generalization; dogs have fears and horses have interests. Professional dog trainers certainly see our share of reactive dogs in one end of the spectrum or another. Probably ponies are most notorious for being distracted by wanting to get TO something (GRASS!). But as a whole, horses’ problems with distractability include the wind, the leaf blowing, the scary plastic bag: all things which may result in spooking and leaving the premises. This was the reason, I thought, that high value treats won’t work for horses’ distractions. If I want to work with my dog’s distraction, all I have to do is become more interesting than the distraction. But for a horse, it doesn’t matter how good a treat I have. If that horse is afraid, he’s not going to be dissuaded by something tasty. I love chocolate and you can certainly use it to train me, and you can use it to reinforce me for staying away from the computer. But if I think I’m about to be chased by a bear, you aren’t going to get me to stand around just because you’ve got chocolate. (note: so instead of using high value reinforcers, one needs to be more skilled at breaking things down, reading the horse's emotional responses, and becoming more trustworthy than the "distraction" is scary)

So I continued to use high value reinforcers for dogs, but not for horses. 

This brings me to the present when I am starting to hear criticism of using high value treats for distracted dogs and I am considering using high value treats with horses again. 

The criticism I hear in the dog world, and so far it’s been second hand, sounds like what I would call inappropriate use because people are using them in situations that are more horse-like! If you have a reactive dog, and a strong stimulus is present, pulling out liverwurst and waving it in front of your dog’s nose to keep his attention is not addressing the problem of reactivity. Maybe your dog responds and maybe he doesn’t but in my view, the issue isn’t being properly addressed. It’s as if you were using peppermints and apples to get a horse past something scary. It might work, but unless it was a very minor stimulus, you likely haven’t changed the way the animal feels and you may need to do it each time to get that horse past the scary thing.

The way I use high value treats with dogs is to begin training where the dog can be successful and I use the lowest value treat available which the dog will respond to. This varies with the individual. Some dogs, represented as “not food motivated”, can only be enticed with the finest of cheeses at first. But as Ken Ramirez says, “if your dog isn’t food motivated, then he’s dead!”. In time, by building a relationship and understanding, those fussy individuals can be trained with plain kibble. 

But once behaviors such as attention, loose leash walking and sits, for example, have been taught in a quiet home environment, we need to slowly introduce distractions. That’s when I pull out a higher value reinforcer. Following Susan Garrett’s guidelines, I rank the distractions for the dog in addition to ranking food (and activity!) reinforcers. Then I balance them. For one dog, a tennis ball on the floor might cause mayhem, so I wouldn’t use that as an initial distraction. For other dogs that ball might be interesting but not highly distracting. If they showed interest in it by looking at it, and then looking at me, I’d reinforce with some cheese. In my mind, the dog says, “ooh, she’s much more interesting than that silly ball”, and we continue to work together. Then I transition back to kibble, even in the presence of the ball. And I find a slightly more distracting item, such as someone slowly rolling the ball back and forth as we walk by. Movement is always more interesting so the dog might look at the rolling ball, but then remember how interesting I am so look at me and stay close on the leash. Out comes the cheese again. Through this slow and steady progress up to more and more distracting things, I teach the dog that I am ALWAYS more interesting than whatever else he might see. Through this process, the dog actually becomes desensitized to distractions in his environment. Personally, I'm not a fan of a dog who stares at me obsessively, but checking in with me and being able to respond to simple requests in the presence of distractions is a goal. Only when the dog is this responsive, even working with kibble, is he ready for me to raise the bar again, when I pull out something special to maintain my special status. 

So why would I ever need anything even higher value? Well, life and the environment can only be controlled to a certain point. Once we step outside of the home environment, we are subject to unplanned distractions. I want to have a really, really good base before I risk outings with potential for the unexpected. When that Rottweiler comes around the corner unexpectedly and barks, or when the UPS man suddenly comes screaming in the driveway, or when that rabbit streaks across the road in front of us, those are times I want something incredibly valuable on me so I can reinforce good responses. I’m not using them to prevent my dog from looking. I’m using them because our incredible history has allowed the dog to respond to me even in the face of a barking Rottweiler, a UPS truck or a bunny and I want to have something that demonstrates how amazing that response was! 

Using high value reinforcers in this way is not interrupting a shaping session and it’s not using the food to distract the dog from something. The way I see it, it’s simply reinforcing behavior I want to see repeated and using a reinforcer worthy of the effort of the behavior. 

So, back to horses, why would I start using high value reinforcers again with horses? Part of my thinking comes from my experiences at NEI (see here for more on that), and partly from one memorable experience with an equine and a high value reinforcer.

When we were at NEI, our instructors stressed the importance of being aware of where the animal was when we reinforced. Now both dog and horse trainers know how to feed for position and to set up for the next rep. But the birds were excellent trainers on more careful thought of this...of being aware of where the history of reinforcement was delivered. If you reinforced a bird on a small board “station” on a perch for just one session, that bird would go directly to that station the next time he was out. If that’s what you want from that bird, that’s great, but if you want flexibility in the behaviors, it’s not so great to have him glued to that station. 

An example of this was one of my training sessions with the corvid. I was to train him to fly from one perch at the front of the cage (I’ll call this perch A), to another perch at the back of the cage (perch B). Through the use of prompting, it was pretty easy to get the bird to fly to that perch and put it on cue. But one time I marked his landing on B, and in bird speed, he hopped immediately back to perch A and then to a third perch which was right in front of me...and I fed him there. Big mistake. Even though I had marked the landing on perch B, the next several times I prompted him to perch B, he instead flew to the perch where I had fed him...once.

Now I do think there were some other factors, namely that the trainers at NEI rarely used verbal markers. Because the birds are almost always looking at them when they train (as opposed to horses and dogs when we want them going away from us or not looking at us at times), the NEI trainers simply feed when the bird does the correct behavior. So even though we conditioned the word “good!” in our early training with the birds, I don’t think it had the power that a click has on my dogs and horses. If my animals hear a click, you can be sure they will repeat that behavior, regardless of where I fed for it . That’s why I can click for a dog sitting and then toss the treat to reset. The dog will return to me to sit (which was where I clicked), not go sit where the food was tossed. 

But in other situations, it does make a difference. Feeding where the perfect horse would be is an example. If we click when the horse is in the correct position next to us, but then feed close to our bodies, that horse’s head is going to be more likely to be too close next time. Yes, it may be what happens between the click and the feeding, but that’s what happened with the bird as well and it affected his future behavior, not just his treat taking behavior. 

In any case, this has made me more aware of what places I may be building up a history of reinforcement for. The story it made me think of was when I first taught Rumer to load into a trailer. At the time, I was still using peppermints as jackpots. In this case, she had never seen the trailer before but had a good history of being reinforced for approaching and touching items which might at first have seemed scary. 

Rumer's comfort with the trailer is maintained by careful driving and not trucking her before she was ready
I used hay stretcher pellets for reinforcing each step up the ramp, allowing her to back off when she wanted. But the next time in, she didn’t get treats at the bottom of the ramp, only when she had progressed beyond the previous attempts. I was building a history of more reinforcement inside. When she got all the way into the trailer, I pulled out a peppermint candy and gave it to her. There was no interruption of shaping; she was where I wanted her to be. Then I asked her to back off (there were many steps through this process which I’m glossing over) and we walked around in a little circle and approached the ramp again. Well that little pony just about dragged me onto the trailer. It was as if she was saying “The good treats are inside!”. All the way in she went, and she did indeed, get a peppermint candy once inside. 
So in that case, it was pretty obvious that place equaled high value reinforcer, and that in time, the value of the reinforcer could transfer so that it was a high value place. Now obviously, just getting in the trailer is only the very first step. She still needed to learn about the butt bar, the ramp, the trailer moving, longer trips, etc. But her enthusiasm of going all the way inside has stuck with me and seems to be a good reason to consider what and where we are giving treats.