Category Archives: design

Gamification Principles for Product Management Revisited

A few of you pointed out that the link to my 2014 article for commercelab is down, so I have uploaded a PDF of it: Gamification principles you should consider in mobile product management

As I read this article, I realized there are two more important aspects that I have learned in the past couple of years that I should share. This is what I would add if I were to write the article today:

Focus on your core, and build out from there

Games have to focus on their core function or they won’t get used. For example, a lot of games focus on movement and actions (fire, gather, etc.) and then add functionality on that. If you don’t have the basics, you won’t have a very good app. If your game has a poor core function, it won’t get used, so their survival depends on it. It’s easy to get caught up in neat features, or cool ideas, but if the core isn’t solid, the experience will suffer. How do you identify the core? Take away everything, and then add back technology and features until people can get the job done with your app and no more.

Summarize and display of important information

Games are creating and operating with huge amounts of data, yet they don’t overwhelm players. They use clever views, HUDs and maps to show you what you need in context, and right now. Some games are brilliant at showing you what is important within your current location and context, yet providing cues to change focus and look elsewhere for important events or information. They are brilliant at information architecture and information display. We are often at a loss with non-game apps and easily overwhelm and confuse users. Games on the other hand have a lot of approaches for showing just the right amount of information, in a way that grabs your attention, right when you need it.

Designing for Smart Fabrics: Wear It’s At – Part 3

In Part 1 of this series, we looked at defining smart fabrics. In Part 2, we looked at some design ideas. In Part 3 we will explore things that could go wrong with this technology, and offer up two possible futures for products using smartfabric tech.

fashion-300337_640
(image via pixabay)

What are the Potential Drawbacks?

If we can access, visualize and interact with our digital lives with fabric, that brings a whole set of implications to design for (privacy, security, etc.) and the challenges of displaying and interacting with systems.

Imagine the possibilities. We will soon have clothing with:

  • built in displays that can show you information, images and video you would normally see on a PC or smartphone screen.
  • interaction with a system using certain gestures by touching your clothing.
  • powerful, tiny sensors that monitor biological functions.

Pretty cool huh? These technologies are currently being developed, and they could open the door to some fantastic possibilities. They also have a darker side, with potential pitfalls.

The most obvious pitfall is to needlessly annoy the wearer with notifications or prompts to interact with their clothing. Over notifying can over stimulate our senses. If vibration or lighting/color changes are used to get our attention, this might be useful if it is used sparingly. If we get a lot of buzzes against our skin, or our clothing rapidly is changing color or displays or lights are blinking at us too much, smartfabrics products could make people sick.

Accidental interactions can cause unintended results. What if I can control my TV shows with my jeans by gesturing on the fabric, but every time I change positions in my chair, I change the channel? Controlling inputs, determining touch targets and gestures, as well as what to display, and how to notify people of events are difficult to implement well on something that is constantly touching your skin. Over-notify and people will want to destroy their clothing, tickle people and they will go crazy.

Target areas for inputs and outputs are important to consider in clothing design. Inputs and outputs need to be placed very carefully on the body. They could draw unwanted attention to a particular area of the wearer’s body. Even if they aren’t highlighting private parts, they may trigger body image issues if it highlights a perceived flaw in the wearer. It’s also easy to imagine accidental or even purposeful unwanted touching – someone could use the input as an excuse to touch you. If the design encourages interaction, it could be easy for someone to be compelled to touch you when they normally wouldn’t. Inadvertently encouraging unwanted touching in our designs could have very serious implications. Unwanted touching is assault.

On the other hand, in private, intimate environments, that sort of touching can be welcome and fun. Context, as always, is key to understanding interactions with things you can wear.

Beyond unwanted touching, pranksters or “griefers” might think it is funny to reach over and mess with your digital interaction by touching the smartfabric device while you wear it. This could cause your data to become corrupted or trigger unwanted events in a system. (What if you were trying to book a calendar event, your friend reaches over and taps their fingers on your shirtsleeve, and now you have a thousand calendar events?)

We live in public, and smartfabrics might accidentally display personal information that we wouldn’t want others to see. What if a private text or email is displayed to my coworkers in a meeting because it is displayed on my shirt? (You might not want that nude selfie your significant other texts you to be displayed on your suit jacket when you are in a job interview.) What if I work in HR and my boss sends sensitive salary information that is displayed to an entire department I am presenting to? It could also be inappropriate for your dress shirt to display your photostream in church, or if your sombre outfit suddenly played the Benny Hill theme during a funeral. Understanding context and appropriateness of what to display and when, and how much control over who might see it users have is vital to understand and take into account.

Security and privacy is a huge issue with smartfabric devices. Data that is gathered from a user wearing smartfabrics is deeply personal. Any information that is passed to other devices or systems absolutely must be secure. That data should never be intercepted and stolen, it is very personal and could be misused and cause great harm to the user. If data transmitted from clothing or other devices could be intercepted by a 3rd party, that could be very embarrassing and potentially damaging if it is used against them. Also, if servers or cloud-based storage facilities are compromised and smartfabric generated user data is stolen, that could be catastrophic to the people whose data has been collected. The inevitable public backlash could be severe enough to destroy a company. Furthermore, data privacy laws could be broken and an organization could be faced with fines, lawsuits and the resulting bad publicity. Everyone loses if the data generated and used by these devices isn’t kept private and secure.

Private information should not be displayed publicly on my smartfabric device unless I want it to be displayed that way. I need to control what is shown, and when with speed and ease. Other people should not see my current status of what is going on with me and my body unless I want them to.

Smartfabric devices need to have their capabilities completely under the control of the wearer. When a feature isn’t appropriate in a particular context, or if something odd happens, the wearer need to be able to turn it off or mute it. Even active smartfabrics that change their form depending on outside triggers require user control to be able to turn it off.

Under controlled conditions (such as the development lab) you may never see irritating behavior, but in the real world strange things can happen. If your dress changes color depending on light and you are at a dance club, the lighting could cause the dress to rapidly change color. That requires a lot of energy if it happens over and over, so the power source could overheat and cause physical trauma (ie. burning) to the wearer. At best, it might wear your battery down prematurely.

Compatibility with other devices and services will also be difficult to address. What if my smartfabric jeans will only work with Android devices, and I only use Apple devices? What if the clothing that looks good on me and fits my budget is incompatible with my file hosting services I use and depend on? What happens if the smartfabric device manufacturer changes alliances, and my favorite suit company now only supports a platform I hate using?

Reliability is another issue that is difficult with clothing because we have to clean it constantly. How do we create hardware that can survive different weather, food and drink spills, sweat and other bodily fluids, and constant washing and drying? Clothing takes an absolute beating, and we subject it to extremes when we wear it, and especially when we clean it. This is an incredibly difficult environment for electronics to survive in, let alone work reliably in.

Two Possible Futures

The Scary Future

If we design smartfabric experiences poorly, we will distract people from their real world experiences, causing them to live diminished experiences when they wear these products. Instead of using technology to enhance their lives, we could burden them even more than our always connected experiences do already. Also, having more devices reading more and more sensitive and private information creates the potential to track people and make decisions about them based on their movements and biological data. This has incredibly serious, far-reaching implications. If people or organizations use this technology to reward or punish people due to the data that is collected, we could literally have a dystopian future on our hands.

If we aren’t careful, we might just create smartfabric products that are expensive, unreliable, irritating and in some cases, downright dangerous. That will be the kiss of death for the technology. If the solutions aren’t designed with empathy for real people, using them in the real world, not to mention our user’s needs, bodies and state of mind, they will quickly be relegated to the dustbin of history. The good that we could do with this technology would be lost because we did a terrible job with the user experience when we introduced our products to market.

The Awesome Future

Back when I wrote programs to help people on software teams be more productive, we used to joke that we were giving them super powers. They could now get visibility and control within systems that was formerly hidden from them, and use that information to make better decisions, or to diagnose and solve difficult problems. Similarly, even though we have many senses and powerful observation skills, there is a lot about ourselves and our environments that we can’t see. Sometimes this information can be incredibly important to get insight into.

I was delighted when Shannon Hoover (MakeFashion) suggested a similar superpower design theme with smartfabrics. Shannon goes beyond the concept of visibility and control, and he believes smartfabrics will eventually provide us with different superpowers by extending our senses, or replacing those that are injured or defective. Shannon says smartfabrics can help provide “X-Ray vision” by reading and presenting certain kinds of important data that are invisible to us. Just like a radio interprets radio waves and brings sound into a living room, smartfabrics have the potential to show us our current location and alert us where to move if we are travelling and get off track.

There are also applications to help provide us more strength and stability, and while we don’t all have access to a SciFi robotic exoskeleton (at least not yet), they are being developed for commercial and health related applications. Shannon goes further pointing out “spidey sense” activities to sense hidden danger, or important events. If the smartfabric is alerted to something that is important for you to know, it can get your attention to warn you immediately. Smartfabrics can use haptic feedback by interacting with your sense of touch in various ways to get your attention quickly.

Smartfabrics that sense danger and warn the wearer can be incredibly powerful. In particular, if our own senses are impaired due to illness, clothing that can warn us when our bodies are unable to can be life changing. Orpyx have created a vest that notifies people who can’t feel their extremities properly. Diabetic neuropathy sufferers can be warned of too much pressure in their feet by using sensors to vibrate against the wearer’s back to warn them. If your feet are getting injured, but you don’t feel pain, you can cause irreparable damage. Augmenting your body with another system to help prevent damage is an amazing feature to improve the life of people with illness and physical conditions. This also has enormous implications for safety gear and clothing for workers.

Once the wearer gets used to the alternative, haptic feedback, it feels as natural as the normal pain signals your body generates that you no longer feel from damaged areas. The technical term for this is “neuroplasticity”. Smartfabrics have the potential to use this as an “extra sense” to seamlessly interact with us in our environments. Shannon sees a future of products that can provide extra senses even for healthy users, to alert them or aid them as they perform tasks in the world so they are safer, happier and more productive.

Smartfabrics also have more whimsical applications that are also important. Imagine that you are at a holiday party in your new dress, shoes and accessories to match. You’re feeling good about yourself until you spot your nemesis from accounting. “That #$%#! She is wearing the same outfit! Disaster!

What do you do?

Smartfabrics to the rescue! You quickly dart out to the powder room, and with a quick, discrete gesture, you change the color of your dress. Crisis averted! This might seem silly compared to important medical or other applications, but this kind of technology would be incredibly useful for our quality of life.

Conclusion

Enhancing our bodies and our life activities with smartfabrics has the potential to enhance our senses, extend our physical capabilities and greatly inform our knowledge and insight. The choice for what future we want to bring to our users is in our hands. Do we want to enhance the lives of people who will use our products, or do we want to needlessly distract them away from what they should be experiencing?

Once smartfabric technology is reliable and inexpensive enough, we designers have some important work to do and not much time to do it in. Therefore, we need to choose what future we would like our customers to have even before we start designing.

Designing for Smart Fabrics: Wear It’s At – Part 2

In Part 1 of this series, we looked at defining smart fabrics. In Part 2, we will look at designing for them.

sewing-machine-925458_640
(image via pixabay)

Deciding What to Design

Work with a Clothing Designer (someone who works with fabrics)

I can’t stress enough how important it is to work with someone who understands making clothing, and other handicrafts out of fabric and textiles. I spoke with Jen Kot, a professional engineer who makes her own clothing, knits and creates all kinds of interesting objects with textiles. As a technical person, she understands how the underlying technology works. As a crafty person, she deeply understands the application and costs of different textiles, the pros and cons of using different materials, what is easier or more difficult to work with, and what looks good.

Clothing is one of the most powerful tools we have to create and reinforce our image, or how we want the world to perceive us. One of Jen’s criticisms of much of the current wearables such as bracelets, watches and glasses are that they look “nerdy.” To a techie, we might not find this to be important. We may overlook the form for the features, and even find something awkward looking to be appealing. When you are competing in a world where fashion dictates what is available for us to wear in stores, we need to
understand how other people want to be perceived
.

When Jen and I brainstormed uses for smartfabrics, my solution ideas were much more functional. Her ideas were much more whimsical and fun. I kept thinking about how the technology could be applied and impact our lives, while she thought about what would look appealing as well as be engaging and fun.

Shannon Hoover, co-founder of MakeFashion, an organization that brings technologists and designers together to collaborate with wearable tech also reinforced this view. He also understands both the visual and technical worlds that are possible with smartfabrics.

Shannon says that many designers and developers are looking at wearables as a suite of tools (detect with sensor, compute data, send it to something else) but he also believes that isn’t very much fun. It seems very engineering-dominated, where we tend to focus on technology first, then apply it to a problem. Instead, Shannon feels we should also look at wearables from an aesthetic perspective (it looks interesting) and as a vehicle for
human expression. This is an artist and fashion-designer focused perspective.

Shannon goes even further, and says that clothing helps people tell the story about who they are – it is a narrative generator. It also gets people talking to you – it gets their attention and evokes emotions. Clothing is a great conversation starter. So what conversations do we want people to have about what we are wearing?

Using fabrics is complex, you need to understand how something looks on a person, how it feels on the skin, what colors are in fashion and how different cuts and shapes look on people. Fashion changes constantly. To make smartfabrics work, we will need both the technical view (here is how we make the technology work) and the fashion designer perspective (here is how we make the product look great and be appealing to wearers.) As a technology designer, talking to people who design clothing and furniture is exciting and helps generate new ideas. I understand the basics of what they are talking about, but their experience and perspective is completely different. When design materials use combinations of different technologies, our solution ideas are much better when we work together with other disciplines and share expertise and different perspectives.

Beyond Clothing

Making clothing is one way to use smartfabrics, but fabrics are used in a lot more things than clothing. For example, Nomex was used in heat shields for the space shuttle, Gore-Tex is used as a tissue replacement in medical procedures, and Kevlar is used to create high performance vehicle components. In fact, IoT developer and bbotx co-founder Geoff Kratz feels that smart fabrics have even more potential in products other than clothing. For example, he sees using smartfabrics in vehicle upholstery could provide alternatives for inputs and displays and other feedback mechanisms for safety purposes. Geoff also sees furniture as another good candidate. Smartfabrics could integrate with entertainment systems to provide an even more immersive experience. Chairs could sync up with other systems and provide you with reminders or safety information. Carpets could have safety lighting that is triggered by darkness or emergency situations. There is enormous potential for these sorts of ideas as well as interactive, connected art applications for homes, and public areas.

Quilter and chemical technologist (and reviewer of this article) Cindy Johnstone shares Geoff’s views. Since she quilts, she immediately thought of applications for blankets. Cindy says that portrait quilts or family quilts are very popular. She says the resolution of the images would be so much better if digital technology could be incorporated. An active smartfabric quilt that could tighten the batting to make it warmer in the winter and relax the fibres for summer use would be useful. People could use one blanket for different seasons, rather than having more than one blanket. Cindy also sees health care applications where adding in technology into blankets used by patients could provide more insight and control into patient care.

Corporate Innovation

As computing and wireless technology “disappears” into real world devices there is enormous potential to solve more interesting problems. We often look to organizations with well-funded R&D (research & development) programs to set the tone for the rest of us. There will be likely be useful, popular smartfabric products developed by some familiar leaders in the tech sector. The space is also ripe for disruption by some new up and coming organizations we haven’t heard of yet. Due to the combination of physical and virtual worlds, investment in these kinds of products will be more expensive than software alone.

One area that organizations are working on developing smartfabric and similar technology for is the health and wellness sector. Calgary-based Orpyx Technologies is a company that provides a wearable sensor platform for healthcare. In one of their products, they use embedded sensors in footwear to help people with diabetic neuropathy. Those with diabetic neuropathy have nerve damage and often don’t feel their limbs as well as other people do. Because they can’t feel when their feet hurt, they can injure them permanently. In severe cases this leads to amputation. Orpyx have developed a system to warn patients before this happens. A sensor-embedded insert worn inside a patient’s shoe gathers info from the sensors (pressure, etc) and transmits it to a smartwatch which then alerts them to potential problems.

Stephanie Zakala, Marketing and Inside Sales Manager at Orpyx says that they have been watching smartfabrics closely as a next step for some of their solutions. For example, rather than using embedded sensors within shoe inserts, a smartfabric sock would be a fantastic solution. So far though, there are technical limitations with the smartfabrics they have looked at. It is difficult to make socks with sensing capabilities that are comfortable, washable, and reliable over time. Stephanie says that clothing is particularly challenging because it creates hostile environments for electronics. Shoes and under garments are worn in conditions with pressure, high heat and humidity. Also, the high cost of many smartfabrics is currently prohibitive for many mass market consumer applications.

Other organizations are using sensors embedded in clothing to measure heart rate, temperature and other vital signs for healthcare, and athletics.

As smartfabric reliability improves and prices go down, many organizations will find them to be a great alternative technology for some of their current solutions. Beyond that, they will create new products and services by using smartfabrics to solve problems we were unable to address without this technology.

Innovation from Maker Communities

Great ideas don’t just come from companies, they can come from crowdsourcing as well. Craft communities are important crowdsourcing resources where people share interesting ideas for clothing and crafts. In these communities good ideas rise up to prominence because they work and are easy to replicate. Currently, there are knitting and quilting clubs, fashion collectives and maker fairs sprouting up all over, where people support each other socially, teach each other new skills, and most importantly, share patterns and design ideas so that others can make the same item.

As people try different patterns that others have created, they put their own unique spin on things, and improve on the original ideas. With such a large community, many ideas are shared and tested at large scale; far outstripping the resources of most companies R&D budgets and timelines might allow. Failure isn’t tied to profits and loss, so people can experiment without fear, and the best ideas tend to win out by becoming popular and emulated more frequently.

Homebrewing was a hugely vital part of early Personal Computer (PC) development, and this spirit of creativity and doing it yourself is evident virtually in craft communities. Adding technology to traditional materials is a natural step. In fact, while researching this piece, I found more people from craft communities that were interested in smartfabrics than technologists.

One community that reminds me of early PC homebrewing and software clubs is Ravelry. Ravelry is a community for people who knit and crochet, and it has a unique blend of features that allow people to share ideas and patterns. Local real-life knitting clubs have been started as a result of people from the same geographic location meeting virtually on Ravelry, then getting together and helping each other out. Sharing patterns and pictures of finished items is a huge part of the Ravelry experience, and popular patterns that help people create things that look good and work start to emerge.

Crowdsourced ideas from maker communities are often more fashion-conscious and whimsical than their corporate counterparts. Sometimes as technologists we forget that having a product that looks good and is fun is just as important to people as a life-saving device. It just depends on context. In fact, products that look good and are fun have a much larger market appeal. Maker communities are an area to watch because they not only filter the ideas for us, they remind us techies that the world can be a fun, colorful place and we need to incorporate those aspects into our designs.

These communities have access to a wealth of knowledge, and as digital designers, we can learn a tremendous amount from them. Once they have experimented with smartfabrics for a period of time, we can benefit from communities of people figuring out what works best for certain applications. These sorts of organizations are filled with people who like to experiment and create things for themselves and their friends. If you’re wondering where to start, Jen Kot says, make what is interesting and useful to you and then share it. The crowd can create at scale, so the good stuff will get copied and become popular.

Frame Your Design Thinking

Solve a Real Problem

When looking at technology first, and then trying to find useful applications of it, we can mistakenly create products that people don’t like. It’s important that technology solutions are actually useful and will be used by real people. Many wearables are not worn after a few months of use. In 2014, Endeavour Partners surveyed people who use wearables and found that one third of activity tracker users stopped using it after six months. Once people get a sense of the data that is measured and how that is reflected in their activities, they don’t seem to find a lot of value in the wearable information anymore.

It is vital to use technology that actually solves problems for people. Author and thinker Simon Sinek talks about “starting with why” we are doing something. In technology, we work a lot with the “what”. We have access to cutting edge technology, and we need to spend a lot of time learning how to master it and apply it. Many wearable and smartfabric demos seem to reflect this. People talk a lot about the technology and how it works, but they fail to make a compelling case for why it’s useful to me in my life and world right now. Very few people care about technical details, they want something that serves a purpose, looks good and fits their budget.

Think of buying a new pair of blue jeans as an example. When I shop, I look for something that solves my problem (I need clothing, specifically a new pair of jeans), that fits my personal style, that I look good wearing, and that I can afford. Invariably, I am drawn to a stylish visual design and a certain level of quality of materials and workmanship. Unfortunately, that means the jeans I would like to consider buying are expensive. Most importantly, the jeans have to fit my body and look and feel good while wearing them. So I start compromising to see if I can find something that fits my budget. If you are a smartfabric designer, how are you going to convince me to pay more money for something that has electronic capabilities in my jeans? It may just feel like an unnecessary extra. You have to convince me, the buyer, why I absolutely need this new technology in my jeans. Will they fit better? Will they look letter? Will they keep me warmer or drier or more comfortable? Will they provide data or notifications that are incredibly handy, or that I just can’t live without once I have them?

Whenever I design something new with complex technology, I strip the problem down to its essence, and I remove digital technology from the solution ideas at first. If I can use paper, pen, materials readily at hand and perhaps some physical services like mail or parcel delivery, what would I do? If you can fully understand the underlying problem you are solving and provide alternate ways of solving it with different technologies, it’s time to add in the digital technology to form a solution. It’s amazing how your perspective changes, and that pet feature you just loved in the technology doesn’t necessarily translate into an ideal product for the people you are designing for.

An ideal product should be so superior using smartfabrics to other, older technology, the customer will want it and will wonder how they got by without it in the past.

Paul Hanson (bbotx CEO) warns designers for wearables to avoid focusing on technology first, then looking for solutions in people’s lives. Instead, when we design wearables for people, we have to think about the person wearing the device first, what they are doing in their lives and how the technology that the device provides is useful for that person. However, it can’t stop there. Beyond the device itself, the generated data and activities recorded or performed by the wearable are much more useful when you take an entire system (such as your interactions with other people) into account. Gathering a lot of data with a smartfabric wearable and displaying that data on a smartphone has limited usefulness.

What does it mean? What should the wearer do?

With passive wearables, which are usually used to gather data, there is limited value in providing activity data only to the end user. There is infinitely more value if that data can be shared with people who can interpret the data, and have special expertise to help apply that to help you improve your life. In healthcare for example, clothing that monitors heart rate is incredibly useful if care givers or specialists have access to the data to help put context around it and point you towards behaviors that will benefit you. This requires a complex, secure computing system to support not only the wearable and the user, but everyone else who needs to be involved.

Active wearables need to interact with a system too – the immediate real world around us. Imagine a winter jacket that changes form depending on temperature so you are always at optimal comfort, or a shirt that changes color depending on lighting. The data the wearable interprets around them can trigger change in the form or attributes to enhance the experience of the wearer. Ideally, the user should be able to control these changes themselves if they want to override them.

Interfaces and Inputs

In my last article on wearables, I suggested that the real world is your primary user interface. With smartfabrics that can be used as clothing, user interfaces can also be on people’s bodies. Not only do you need to understand where the user is, what they are doing and what the environmental conditions are, you also have to understand where on the user’s body the user interfaces and inputs will take place.

Finally, you have to understand the inputs and outputs and displays themselves. This is incredibly challenging.

On a PC, we are used to input methods (keyboards, pointers, stylus, microphones, fingers, etc.) and output on a screen, from speakers etc. The end user tends to use the PC in more ideal conditions, and we don’t think too much about what else is going on around them. Mobile devices complicate I/O matters, because now we have to think about limited actions, and what else is going on in their world as they use our programs on the move.

Wearables such as smartwatches and activity trackers complicate this further, since they can overly distract from our real world activities, and since we are wearing them on our wrists or clipped on to clothing, we can’t get away from them if they needlessly over stimulate us with notifications and alerts. With smartfabrics used in clothing or furniture, the devices are right up against our skin and have much more opportunity to distract and annoy us. Can you imagine how terrible an experience could be if your clothing was vibrating or lighting up and you couldn’t stop it? It could be embarrassing, irritating, and could even cause injury to the wearer.

Deciding where to provide inputs and outputs on smartfabric is incredibly important for a design. With furniture or objects we interact with, it can be more straight forward, but would still require a lot of user testing with different users to get right. For clothing, it gets much more complicated. What are sensitive areas of the body we would want to avoid for inputs? How about appropriate areas for screens or lights or other outputs? If outputs or inputs they draw attention to private parts of the body, that could be disastrous in public, or just the right thing in private. We do not want to expose our customers to unwanted attention or touching, and they need to be in control of their own bodies and what technology can do to enhance them.

Smartfabric designers need to think of inputs and outputs for smartfabrics:

  1. What is around users in the real world and what activities will be enhanced by the technology
  2. The human body – where and what is useful with regards to inputs and outputs what is and feasible to put on or around our bodies and appropriate given the context of use
  3. The inputs and interface designs themselves

Design for Simple Interactions

On mobile devices, we have learned that we can distract people needlessly and take away from their real-life experiences rather than enhance them. If an app is annoying, people just delete it and move on. As designers, we must understand the context of use, such as the environment around users, and what they want to do at a particular time with the technology. We also know that people have less time and space to interact with mobile devices than they do with larger screens, so we have to develop for quick, economic interactions rather than a long workflow. For example, if I am walking outside with my smartphone, it is much harder to interact with than when I am sitting comfortably at a desk typing on my PC. If I am in a hurry, or I am in bad weather, it is even more difficult.

Now think of clothing you are wearing that is designed with smartfabrics. They are even more difficult to interact with than a small smartphone. What is going on around us and our limited ability to see and interact as we move around are amplified with smartfabrics. Imagine how irritating it would be to not be able to control or turn off notifications on your clothing, or how dangerous it might be if the smartfabric distracts you when you are walking, driving or riding a bicycle. The simple interactions mantra that mobile designers repeat over and over is that much more important to take into account with smartfabrics.

MakeFashion co-founder and UX designer Chelsea Klukas says: “…the most successful mobile products have created experiences that quickly allow customers to continue a task after interruption. With wearables these interactions will become even briefer, and successful experiences will need to be quick with minimal interruption to the user. Interfaces will need to be designed to rely on simple one-tap inputs and voice commands that can be achieved instantly.”

With wearables, the real world should be your primary user interface because that is what holds the most attention for the wearer, not the technology. Wearable technology should be designed to work within that context to complement real-life experiences. Chelsea says: “As wearables gain widespread adoption, we are going to have to be increasingly sensitive to the amount of interruptions and distractions they cause. When used correctly, wearables can be incredibly useful in providing information, wayfinding, or accessibility. When used incorrectly, they can become distracting and provide interruptions to user’s tasks and routines.”

Wayfinding came up a lot when I talked to people about possible applications of smartfabrics. Shannon Hoover suggested that smartfabric clothing that could sync with a map service would be hugely beneficial for tourists and travellers. If clothing provided tactile indications (such as through the use of a vibration motor) and subtle visuals, finding your way in an unfamiliar place could be much more enjoyable than having your face in a smartphone or an old fashioned map. You could focus on your surroundings, and have a richer experience, without worrying about going off your planned route. The clothing would remind and guide you. This could also be safer, you wouldn’t be a target as an obvious tourist to pickpockets or scammers.

Others described ideas using smartfabrics for people operating a vehicle. This technology would not be as visually distracting as looking at a smartphone or GPS map. Motorcyclists and bicycle commuters in particular found this a welcome change. Instead of relying on a hand held or mounted device that would distract their visual attention away from where the vehicle was heading, they could get tactile indications of where to go.

Smartfabrics could provide the ultimate handy interface for quick reference, reminders and interactions on the go, or they could interrupt needlessly and distract away from our real world experiences. Furthermore, since the human body is a secondary user interface, there is really very little difference between touching fabric on your body and touching bare skin. Imagine rubbing your thigh in one spot 100 times a day. How do you think your leg would feel in an hour, in a day, or after a week?

Simplicity is not only necessary for a good user experience, it could be necessary for our health, well being, and our relationships.

In Part 3 we will look at things that could go wrong with this technology, and offer up two possible futures for products using smartfabric tech.

Designing for Smart Fabrics: Wear It’s At – Part 1

Lately, the term “wearables” appears more and more in our conversations. Usually we are describing a smart watch that extends our mobile experience, or a bracelet that tracks physical activity. Sure, those are things we wear, but what about something with computing power that we actually put on as clothing? Now that is something that is really a wearable. This next wave of wearable moves technology beyond accessories to clothing we wear, furniture we use, vehicles we are transported in and art that we enjoy.

This is made possible through smartfabrics. Smartfabrics are textiles with embedded electronics that bring computing power even further from our devices into everyday items. This technology poses new challenges for designers. Not only is the form factor very different from screen devices, it is right up against the user’s skin.

needle-672396_640
(image via pixabay)

This is an interesting topic for me. While I have done design work with smartwatches, wearable integration and for Internet of Things (IoT) devices, I haven’t worked with smartfabrics yet. So I reached out to people in the community who have more insight than I do, and asked for their thoughts to share on the future of this technology. This is more of a forward-looking piece than my usual experience-reports, so I will likely get some of it wrong. However, a lot of you have been asking me to weigh on on this topic. Furthermore, the low impact, high value principles behind designing for this technology are important to take into account as we move forward. We might have a limited window of opportunity to get it right.

In my last article on wearables Designing For Smartwatches And Wearables To Enhance Real-Life Experience, I wrote about designing experiences that integrate smartwatches and activity trackers. I mentioned that we have two futures for technology: in one, we are distracted away from our real-world experiences, increasingly focused on technology and missing out on what is going on around us; in the other, technology enhances our life experiences by providing a needed boost at just the right time. Understanding good distractions as well as unwelcome distractions is vital to consider when you are designing for something that you will have right up against your skin for hours at a time on a daily basis. With smartfabrics, we have even more potential to cause harm by distracting people from their lives, or to bring even more good by using powerful technology to enhance our real-life experiences.

As I spoke with people who design with smartfabrics and similar technology, a common theme emerged: smartfabrics aren’t quite there yet for mass market applications. There are some niche players leading the way, but nothing has captured significant mind share. That’s because it’s difficult to bring computing and electronics, power sources, sensors and wireless connectivity to fabrics without making them bulky, impractical, and expensive. However, a lot of great organizations with brilliant people are working hard to create reliable, cost-effective smartfabric technology, so the day will arrive soon. When it does, those of us who are technology designers will be designing digital experiences that are completely different from the screen experiences we are accustomed to. It’s important to understand that we are designing a digital experience that supplements a user’s real-world experience.

Know Your Design Material

Electronics

One way to think about smartfabrics is that they are Internet of Things (IoT) devices. In his talk Magical UX and the Internet of Things , mobile UX expert Josh Clark defined IoT devices as “Sensors + Smarts + Connectivity”. A “thing” is anything at all that we can put technology into. “Sensors” are what make mobile devices and wearables truly special, they can sense movement, direction, and in some cases even biometric data.

“Smarts” refers to computing power and electronics that makes sense of data, and supports inputs and outputs into the system.

“Connectivity” allows us to get information from the thing onto smartphones
and other devices. It is one thing to have a wearable that measures or allows for inputs and outputs, but if it can only work by itself and not communicate with other computers, it has limited value.

Sensors, smarts and connectivity depend on power sources to operate, which means they need batteries to make them work.

Smartfabrics are textiles with IoT-style technology woven into them. Some technologies added to textiles are sensors, wireless, batteries, location services (such as geo-positioning tech), transducers, bio monitors, lighting and displays. New kinds of fabrics blur lines further with electronics in the development of conductive thread for inputs, and stretchy displays, circuit boards and wiring embedded right into the fibers or printed on the fabric. In some cases you can barely tell the difference between smart fabrics and traditional textiles.

IoT devices provide visibility and control into just about anything we can stuff technology in. Paul Hanson, CEO of IoT technology company bbotx points out that they “help create enhanced situational awareness.” In other words, IoT devices can help us extend our own capabilities by providing visibility and control into our environments, our interactions with other people and systems, and within ourselves. For example, health monitoring with wearable IoT devices can provide constant flows of data so the wearer can make better health decisions. With IoT technology, this insight is also available to health experts. What was once a sporadic activity – that required an appointment, specialized equipment and expertise – can now be an ongoing, continuous activity. These systems provide a degree of insight into a patient’s day to day conditions that was impossible before. Patients get visibility into their current condition at any time, and experts can closely monitor changes and recommend treatment options.

Doug Hagedorn, CEO of Tactalis describes two different kinds of smartfabrics: passive and active. Passive smartfabrics are designed towards monitoring and gathering information to for use within a system. Active smartfabrics react immediately to stimulus in the environment and may change physical aspects such color, shape or their digital behavior. Passive smartfabrics have enormous potential in areas such as health and fitness, while active smartfabrics could reduce the need for multiple articles of clothing that have one particular purpose and design.

Fabrics & Materials

If you are a digital designer who like me who in virtual worlds all the time, integrating software with real world physical objects can be a challenge.

Textiles are commonplace enough to appear simple, but they are subtly complex. From ancient times, we have used animal and plant-based materials to clothe ourselves for protection and warmth. Eventually, we brought in metals and other minerals as materials. (The most obvious example of this is medieval armor such as chainmail.)

As technology advanced further, we moved beyond natural resources and started making synthetic fabrics. Today, textiles are sophisticated combinations natural, synthetic, mineral and other materials. We take them for granted because they are all around us, and the complexity is hidden from us.

The choice of material when designing clothing or other textile goods brings with it different strengths and weaknesses for warmth or cooling, comfort or sturdiness, and care when dirty.

To get more out of a particular fabric, we combine different materials to make it even more useful for a particular purpose. Some interesting examples of technology fused with technology are:

  • Kevlar used in fabrics for protective wear
  • Gore-Tex Water repellant technology to keep us warm and dry
  • Nomex provides flame resistance
  • Spandex provides support for athletic wear and underwear
  • Conductive thread in our mittens and gloves allows us to use our touchscreens in the cold.

When you weave these powerful fibers into fabric for use in clothing, it allows the wearer to do things that were previously difficult or impossible. In most cases, you wouldn’t even know that complex technology is in your clothing unless you looked at the label. Similarly, as electronics become smaller, they become a part of the purpose of the clothing. They fade into the fabric so that we don’t even notice them. Smartfabrics have the potential to allow us to do much more with clothing and other objects than we can with traditional fabrics. The key as a designer is to know exactly what kind of smart fabric you require to solve a problem for your users.

Stay tuned for Part 2, as we look at smartfabric design potential.

New Article – Designing For Smartwatches And Wearables To Enhance Real-Life Experience

I expanded on my blog post on this topic and wrote an article for Smashing Magazine: Designing For Smartwatches And Wearables To Enhance Real-Life Experience.

Now that smartwatches and wearables are in a huge growth phase, I shared my ideas on treating the real world as your primary interface, and developing app experiences that enhance our lives, rather than needlessly distract.

Lessons Learned When Designing Products for Smartwatches & Wearables

Lately, I have been doing a bit of work designing products for smartwatches and wearables. It’s a challenge, but it is also a lot of fun. I’m just getting started, but I’ll try to describe what I have learned so far.

Designing for these devices has required a shift in my thinking. Here’s why: we have a long and rich history in User Experience (UX) and User Interface (UI) design for programs written for computers with screens. When we made the leap from a command line interface to graphical interface, this movement exploded. For years we have benefitted from the UX community. Whenever I am faced with a design problem when I’m working on a program or web site, I have tons of material to reach for to help design a great user interface.

That isn’t the case with wearables because they are fundamentally different when it comes to user interaction. For example, a smartwatch may have a small, low-fidelity screen, while an exercise bracelet may have no screen at all. It might just have a vibration motor inside and a blinking light on the outside to provide live feedback to the end user.

So where do you start when you are designing software experiences that integrate with wearables? The first thing I did was look at APIs for popular wearables, and for their guidance on how to interact with end users. I did what I always do, I tried to find similarities with computers or mobile devices and designed the experiences the way I would with them.

Trouble was, when we tested these software experiences on real devices, in the real world, they were sometimes really annoying. There were unintended consequences with the devices vibrating, blinking, and interrupting real world activities.
“AHHHH! Turn it off! TURN IT OFF!!”

Ok, back to the drawing board. What did we miss?

One insight I learned from this experience sounds simple, but it required a big adjustment in my design approach. I have been working on software systems that tried to make a virtual experience on a computer relatable to a real-world experience. With wearables devices that we literally embed into our physical lives, that model reverses. It can mess with your mind a bit, but it is actually very obvious once it clicks in your brain.

Simply put, when I don’t have a UI on a device, the world becomes my UI.

Let me expand on my emerging wearable design approach to help explain why.

Understand the Core Value Proposition of Your Product

If you’ve been developing software for computers and mobile devices already, this may sound simple, but it can actually be a difficult concept to nail down.

One approach I take is to reduce the current features. If we cut this feature, does the app still work? Does it prevent the end user from solving problems or being entertained? If we can cut it, it might be a supporting feature, not a core feature. Remember, wearables have less power and screen real estate, so we’ll have to reduce. When I had a group of core features remaining, now it is time to summarize. Can we describe what these features do together to create value and a great experience for users?

Another approach I use is to abstract our application away from computing technology altogether. I map out common user goals and workflows and try to repeat them away from the PC with a paper and pen. With an enterprise productivity application that involved a lot of sharing and collaboration, I was able to do this with different coloured paper (to represent different classes of information), folders (to represent private or shared files), post-its and different coloured pens for labelling, personalization.

In a video game context, I did this by reducing the game and mechanics down to a paper, pen, rule book and dice. I then started adding technology back until I had enough for the wearable design.

Now, how do you describe how you are different? Have you researched other players in this market? Who are your competitors, or who has an offering that is quite similar? How are you different? What sets you apart in a sea of apps and devices? This is vital to understand and express clearly.

How do I know if I am done, or close enough? As a team, we should be able to express what our product is and what it does in a sentence or two. Then, that should be relatable to people outside of our team, preferably people we know who aren’t technologists. If they understand the core offering, and express interest with a level of excitement, then we are on our way.
If you are starting out new, this can be a little simpler since it is often easier to create something new than to change what is established. However, even with a fresh, new product, it is easy to bloat it up with unneeded features, so have the courage to be ruthless about keeping things simple, at least at first.

Research and Understand the Device

With wearables and mobile devices in general, the technology is very different than what we are used to with PCs. I call them “sensor-based devices” since the sensors are a core differentiator from PCs and enable them to be so powerful and engaging to users. The technical capabilities of these devices are incredibly important to understand because it helps frame our world of possibilities when we decide what features to implement on wearables and smart watches. Some people prefer to do blue-sky feature generation without these restrictions in place, but I prefer to work with what is actually appropriate and possible with the technology. Also, if you understand the technology and what it was designed for, you can exploit its strengths rather than try to get it to do something it can’t do, or does very poorly.

This is what I do when I am researching a new device:

  • Read any media reviews I can find. PR firms will send out prototypes or early designs, so even if the device hasn’t been released yet, there are often some information and impressions out there already.
  • Read or at least skim the API documentation. Development teams work very hard to create app development or integration ecosystems for their devices. If you aren’t technical, get a friendly neighbourhood developer on your team to study it and summarize the device capabilities and how it is composed. You need to understand what sensors it has, how they are used, and any wireless integration that it uses to communicate to other devices and systems.
  • If they have provide it, thoroughly read the device’s design/UX/HCI guidelines. If they don’t, read others that are offering similar. For example, Pebble smart watches have a simple but useful Pebble UX Guide for UI development. It also refers to the Android and Apple design guidelines and talks about their design philosophy. Pebble currently emphasize a minimalist design, and recommend creating apps for monitoring, notifications and remote control. That is incredibly helpful for narrowing your focus.
  • Search the web – look for dev forums, etc. for information about what people are doing. You can pick up on chatter about popular features or affordances, common problems, and other ideas that are useful to digest. Dev forums are also full of announcements and advice from the technical teams delivering the devices as well, which is useful to review.

Determine Key Features by Creating an Impact Story

Now we can put together our core value proposition and the device’s capabilities. However, it’s important to understand our target market of users, and where they will use these devices, and why. I’ve been calling these types of stories different things over the years: technical fables, usage narratives, expanded scenarios and others, but nothing felt quite right. Then I took the course User Experience Done Right by Jasvir Shukla and Meghan Armstrong and I was delighted to find out that they use this approach as well. They had a better name: impact stories, so that is what I have adopted as well.

What I do is create an impact story that describe situations where this sort of technology might help. However, I frame them according to people going about their regular everyday lives. Remember that stories have a beginning, middle and end, and they have a scene, protagonists, antagonists, and things don’t always go well. I add in pressures and bad weather conditions that make the user uncomfortable, making sure they are things that actually occur in life, trying to create as realistic situations as I can. Ideally, I have already created some personas on the project and I can use them as the main characters.

Most people aren’t technology-driven – they have goals and tasks and ideas that they want to explore in their everyday lives and technology needs to enable them. I try to leave the technology we are developing out of the picture for the first story. Instead, I describe something related to what our technology might solve, and I explore the positives, negatives, pressures, harmonies and conflicts that inevitably arise. From this story, we can then look at gaps that our technology might fill. Remember that core value proposition we figured out above? Now we use this to figure out how we can use our technology platforms to address any needs or gaps in the story.

Next, we filter those ideas through the technical capabilities of the device(s) we are targeting for development. This is how we can start to generate useful features.

Once we get an idea on some core features, I then write three more short stories: a happy ending story (what we aspire to), a bad ending story (the technology fails them, and we want to make sure we avoid that) and a story that ends unresolved (to help us brainstorm about good and bad user experience outcomes.)

Impact stories and personas are great tools for creating and maintaining alignment with both business and technical stakeholders on teams. Stories have great hooks, they are memorable, and they are relatable. With experienced people, they remind them of good and bad project outcomes in the past, which help spur on the motivation for a great user experience. No one wants their solution to be as crappy as the mobile app that let you down last night at the restaurant and cost you a parking ticket.

Use the Real World as Your User Interface

UX experts will tell you that concrete imagery and wording works better than abstract concepts. That means if you have a virtual folder, create an icon that looks like a folder to represent what it is by using a cue from the physical world. What do we do if we have no user interface on a device to put any imagery on it at all? Or maybe it is just very small and limited, what then? It turns out the physical world around us is full of concrete imagery, so with a bit of awareness of a user’s context, we can use the real world as our UI, and enhance those experiences with a wearable device.

Alternate Reality Games (ARGs) are a great source of inspiration and ideas for this sort of approach. For a game development project I was working on, I also looked at Geocaching mechanics. Looking to older cellular or location-based technology and how they solved problems with less powerful devices is an enormous source of information when you are looking at new devices that share some similarities.

I talked to a couple of friends who used to build location-based games for cell phones in the pre-smartphone era, and they told me that one trick with this approach pick things that are universal (roads, trees, bodies of water, etc.) and add a virtual significance to them in your app experience. If I am using an exercise wearable, my exercise path and items in my path that I pass by might trigger events or significance to the data I am creating. If you run past significant points of interest on a path, information notifications to help cheer you on can be incredibly rewarding and engaging.

Enhance situational activities

One thing that bugs me about my smartphone is that it rarely has situational awareness. I have to stop what I am doing and inform it of the context I am in and go through all these steps to get what I want at that moment. I want it to just know. Yesterday I was on my way to a meeting in a part of town I am bit unfamiliar with. I had the destination on my smartphone map, without turn by turn directions turned on. I had to take a detour because of construction, so I needed to start a trip and get turn-by turn directions from the detoured area I was on. I pulled over to the side of the road, pulled out my smartphone, and I spent far too long trying to get it to plan out a trip. I had to re-enter the destination address, get the current location I was at and mess around with it before I could activate it. A better experience would be a maps app that would help and suggest once it senses you have stopped, and allow you to quickly get an adjusted trip going. While you have a an active trip, these devices are quite good at adjusting on the fly, but it would be even better if they knew what I was doing and suggested things that would make sense for me right now, in that particular situation.

It is easy to get irritating and over suggest and bug people to death about inconsequential things, but imagine you are walking past your favorite local restaurant, and a social app tells you your friends are there. Or on the day you usually stop in after work, your smartwatch or wearable alerts you to today’s special. If I leave my doctor’s office and walk to the front counter, a summary of my calendar might be a useful thing to have displayed for me. There are many ways that devices can use sensors and location services to help enhance an existing situation, and I see a massive amount of opportunity for this. Most of the experience takes place in real life, away from a machine, but the machine pops up briefly to help enhance the real life experience.

Rely on the Brain and the Imagination of Your User

If we create or extend a narrative that can make real world activities also have virtual meaning, that can be a powerful engagement tool. One mobile app I like is a jogging app that creates a zombie game overlay on your exercise routine. Zombies, Run! is a fantastic example of framing one activity into a context of another. This app can make my exercise more interesting, and gets your brain involved to help focus on what might become a mundane activity.

With a wearable, we can do this too! You just extend the narrative of what you created on your job and delay telling you what happened until you are complete, and have logged in to your account on a PC or smartphone/tablet. You have to reinforce the imagery and narrative a bit more on the supporting apps on devices with a screen.

ARGs really got me thinking about persisting a narrative. It is one thing to apply virtual significance to real-world objects, but what happens if we have no user interface at all? What are we left with? The most powerful tool we have access to is our human brains, so why not use those too? Sometimes as software designers I think we forget about how powerful this can be, and we almost talk down to our users. We dumb everything down and over praise them rather than respecting that they might have different interpretations or alternative ways of creating value for themselves with our software. Just because we didn’t think of it doesn’t mean it has no merit. It does require a shift towards encouraging overall experiences rather than a set of steps that have to be followed, which can be challenging at first.

Wearable Integration – Data Conversion

If you are working with a wearable that doesn’t have a screen or UI, and is essentially a measuring device, one option to tie in your app experience is to think of converting the data from one context into another. This can be done by tying into APIs for popular wearables. You don’t have an app on the device, but your device ties into the data that is gathered by it and used for something else. For example, convert effort from an exercise wearable into something else in your app. One example of this is Virgin Pulse, an employee engagement application that has a wearable that tracks exercise. Exercise with the wearable can be converted into various rewards within their system. The opportunities for this sort of conversion of data that is measured for one purpose to another experience altogether are endless.

One app I designed extended data generation activities to a narrative in an app. We extended the our app concepts to the physical activity and tapped into the creative minds and vivid imaginations of the humans using the devices with a few well placed cues. This was initially the most difficult app for me to design, but it turned out that this was the overwhelming favourite from a “fun to use” perspective. The delay between generating the data out in the real world, and then coming home and using your PC or tablet to discover what your data measured by the wearable had created in our app was powerful. Anticipation is a powerful thing.

However, be careful when you do this. Here are a couple of things to be aware of:

  • Make sure the conversion rules are completely transparent and communicated to the users. Users need to feel like the system is fair, and if they feel taken advantage of, they will stop using your app. Furthermore, many consumer protection groups and laws could be broken in different jurisdictions if you don’t publish it, and change it without user consent.
  • Study currency conversion for ideas on how to do this well. Many games use the US dollar as a baseline for virtual currencies in-game, mirroring the real world markets. These are sophisticated systems with a long history, so you don’t have to re-invent the wheel, you can build on knowledge and systems that are already there.
  • Add Variability Design Mechanics to Combat Boredom

    It can be really boring to use a device that just does the same things over and over. Eventually, it can just fade into the background and users don’t notice it anymore, which causes you to lose them. If they are filtering out your app, they won’t engage with it. Now, this is a tricky area to address because the last thing you want to do is harass people or irritate them. I get angry if an app nags me too much to use it like some needy ex, or try hard salesman. However, a bit of design work here can help add some interest without being bothersome, and in many cases, add to the positive experience.

    Here are some simple ideas on adding variation:

  • Easter Eggs: add in navigation time savers that will be discovered by more savvy users and shared with friends to surprise and delight
  • Variable Results: don’t do the same thing every time. Add in different screen designs for slightly different events. One trick is to use time and seasons as cues to update a screen with themes that fit daytime, night time, and seasons. Another is to use the current context of use to change the application behaviour or look. There are lots of things you can do here.
  • Game Mechanics: levelling and progression can help people feel a sense of progress and accomplishment, and if there are rewards or features that get unlocked at different levels, it can be a powerful motivator. It also adds dimensions to something repetitive that changes the user’s perspective and keeps it from getting stale.

Provide for User Control and Error Correction

As we learned when designing notifications for a smartwatch, it can be incredibly irritating if it is going off all the time and buzzing on your wrist. Since wearables are integrated with our clothing, or worn directly next to our bodies, it is incredibly important to provide options and control for users. If your app is irritating, people will stop using it. However, one person’s irritating is another person’s delight, so be sure to allow for notifications and vibrations and similar affordances in your product to be turned on and off.

Conclusion

This is one of the most fun areas for me right now in my work, and I hope you find my initial brain dump of ideas on the topic helpful. Sensor-based devices are gaining in popularity, and all indications show that some combination of them will become much more popular in the future.

Interview with Anna Sort: Gamification in Health Care – Part 2

This is Part 2 of my interview with Anna Sort. If you haven’t already, check out Part 1 of the interview. Anna is a professional nurse who is working to bring together smartphone and video-game technology into healthcare. She is also an Associate Professor at the University of Barcelona, and works both as a gamification and as a serious games consultant.

Designing a Better Life Interview with Anna Sort – Part 2

Jonathan: What can go wrong with a system that utilizes technology and gaming mechanisms with a worldwide pool of contributors (aka “the crowd”)? For example, how do you design your game to prevent or deal with the abuse the rules or take advantage of bugs or loopholes?

Anna:
I think you cannot really prevent people from trying to cheat in a game, it is part of the challenge and the fun for some people to try to exploit games, so you just have to do your best designing to make it fun to play the regular way rather to make it “uncheatable.”

In our World of Warcraft diabetes add-on we are still deciding if we want the add-on in itself to be fun or not. However, what is clear is that if people wantsto cheat they are allowed to. The add-on is created to fit an exploring environment rather than a “win” situation, it is there for the player to decide whether to play using risky behavior and try what happens if you mix certain things/eat certain foods or to try their best to always “keep in track” with their glucose. It will definitely be exciting as well to see what people will do with the add-on in the end! We are here to learn about how people interact and react to “serious gaming” (using an already existing game for other learning purposes).

Jonathan: What are the biggest challenges you face from a design perspective to create something that people will interact with? How do they apply their virtual learning to their own real lives?

Anna:
This is a very interesting question and is something we ask ourselves. This isn’t explored that much in “serious games” in general. We hope to find out more about this with this experiment. However, we hope to help people understand how the diet and exercise affects diabetes, so in this first experiment we aren’t looking to change behavior in real life, but we will have a couple of questions regarding whether users have made any changes in their lifestyle at the end of the experiment.

Jonathan: What does success look like for your World of Warcraft Diabetes mod project?

Anna:
This is a very difficult question. In this first trial it will be complicated to have a bar to measure to say: “Yes, I’ve succeeded”. At the moment we are working on the add-on but there is a lot of work to do regarding questionnaires. How many will download it? How many will play it? What will be their reaction? There is a lot of work still to be done to determine a good answer for this question.

Jonathan: No problem. When you are truly innovating, you don’t really know until you try out an idea, discover what happens, and refine. Moving on, what new thing/trend/innovation are you keeping your eye on at the moment? Is there anything else you’d like to share with us?

Anna:
I’m very much into gamification and self-tracking apps. I’m a nurse so I’m all about prevention and I think mHealth (mobile health) offers us a great opportunity to focus on that and giving the user tools to take charge in their well being, lifestyle and health.

For more on these ideas and more, check out Anna’s latest presentation: Video Games and Gamification for Health Care .

Jonathan:
Thank you again Anna. I hope for the best in your work, and thanks for contributing to something that is important to all of us!

If you’d like to help out Anna with her WoW diabetes mod project, contact me and I’ll put you in touch with her and her project team.

Interview with Anna Sort: Gamification in Health Care – Part 1

For my first blog interview in my Designing a Better Life series, we will be chatting with Anna Sort. Anna is a professional nurse who is working to bring together smartphone and video-game technology into healthcare. She is also an Associate Professor at the University of Barcelona, and works both as a gamification and as a serious games consultant. I find Anna inspiring because she is working hard in the area of mHealth (mobile health) and games for health.

anna_sort
Anna Sort speaking at the Gamification World Congress

Anna is based in Spain, and graciously agreed to this interview in English for me, and for you, our readers. For more about Anna, check out her blog: Lost Nurse in the Digital Era and these two videos on youtube of her presenting: Designing Games as a Nurse, Gamification of Health Products.You can find her on Twitter here: @LostNurse.

Designing a Better Life Interview with Anna Sort – Part 1

Jonathan: Please tell us a bit about yourself. How did you get involved in the games for health field?

Anna:
I have always been a gamer but programming never attracted me. I was looking for a job as a nurse abroad when Blizzard Entertainment called me to be a customer support representative in France. They offered to take care of housing and banking, making it easy to move and start work in a new country. Also the multinational office work was something I had always wanted to try (and being a CS for the game World of Warcraft also seemed very cool). After 6 months I took the nurse spot in the company, and being a gamer working with gamers made me realize how much easier it would be to communicate and experiment some health information through games rather than 30 minute talks plus a flyer to never read at home.

After a while I started to look for Masters degrees that would allow me to go into a “techie-nurse” path. I found an interesting Master’s degree called CSIM, which was focused on a multidisciplinary approach to problem solving. I was the only healthcare student in the class, most of my classmates were designers, artists and programmers, but surprisingly 2 of the 8 Masters Thesis projects would have benefited from a healthcare professional, a rehabilitation system and an exergaming platform. In a way that reassured my idea that this “new profession” I wanted to pursue would eventually exist.

My thesis was about the quantity of exercise the children did while playing on an inflatable slide that had a game projected on and kids interacted with through an infrared system (it’s called an “exergaming platform”). I took part in the game design as well as the exercise experiment for my thesis so it was really interesting. I worked on a multidisciplinary team and I loved it. After my master’s I started my career alone, and soon enough I was contacted by Homero Rivas in Stanford, whom I talked about my vision in games and we are currently developing with MIT the first World of Warcraft health add-on to raise awareness on Diabetes.

Jonathan: The research and work that you do sounds fascinating. Can you explain how your work can help make our lives better?

Anna:
Behavior-wise humans are prone to play, and games offer a wide variety of play, such as exploring, competing, collaborating and self expression. Taking gaming into healthcare is a way to make taking charge of one’s health more interesting, intriguing and motivating. It is not about making fun of having diseases or trivializing them, making it less important because it’s a game. It’s about providing the tools and inspiring the motivation and behavior change to be healthy and improve your lifestyle.

Jonathan: I love your World of Warcraft Diabetes mod project. Can you tell us about this project and your goals? Is there anything we can do to help you?

Anna:
Thank you. It is a very exciting project indeed, and challenging! Especially because the game World of Warcraft has a pool of 9 million users, which means if 5% of these users download and play the add-on, we will have the biggest Health Game research experiment ever made!

The add-on is an “add” on the game which you download that changes the user interface. What we have done is add a glucometer on the side that is impacted by the player’s actions, such as running, fighting and eating foods. World of Warcraft has a lot of foods, drinks and alcoholic beverages so it makes the experimentation part very interesting. It isn’t focused on the disease itself, as we are aware not everyone reacts the same way to foods and drinks, and compositions aren’t equal worldwide. We want to raise awareness, and maybe even make new users having youngsters encourage family to play to see what is it like to live with diabetes.

We are not sure what people we will attract and we also are still debating whether we should gamify the add-on or if the game is good enough as-is people will still enjoy the game with the add-on. All the steps should be taken care of very wisely as the amount of research information might overwhelm us otherwise and turn out to be unusable.

How can people help? We still need a good experiment designer to take part of the team, so anything on that regard is helpful. And programmers. Hands are always needed!

Jonathan: What design concepts do you find the most useful for this project?

Anna:
Possibly the most important part of our design process will be focused on the tutorial. World of Warcraft has an excellent tutorial to help new players get on board, and since the new players we might attract will already have a whole game to learn, we want to make sure the on-boarding of the add-on doesn’t collide with the game tutorial and so it doesn’t overwhelm the player.

Stay tuned for Part 2.

Designing a Better Life

Often, my public work lags behind my current interests or passions. That’s ok, it usually catches up in time. However I wanted to talk about my current focus and passion right now: designing systems for a better life. If you read my blog regularly, you will notice a shift towards design, user engagement and other topics. I wanted to explain why.

This has been a tough year. I’ve been on the road a lot, and I have met a lot of fantastic people and worked with some amazing organizations. However, I have been away from my family and friends here at home, and I have missed out locally. The Alberta flood disaster forced me to look at my local, real life. This spring we found ourselves evacuated from our home, staying with friends wondering if the flood would wipe out our house and property. Unlike many others, we were very fortunate and came home to no damage, but it changed our perspective. A few days earlier, we took for granted that we had a safe, dry, secure home to always use as a refuge no matter what happened in our work or public lives. We came home and celebrated with our neighbors that we were all ok, and then we did what we could to help each other. I realized I need to do more to contribute to my local community as well as virtual communities.

The Alberta floods, like so many natural disasters, brought the best out in people. Organizers were turning away volunteers because they had too many, and entrepreneurial types turned their energies towards creating systems to harness that energy and that willingness to help others. I was amazed at how people used social media to mobilize people to work for a common goal and to help out others. Mobile technology wasn’t just about screen sizes and sensors and wireless conditions or merely staying informed about the emergency going on around them, (which was incredibly useful and important.) What was more interesting was the technology was helping people help others, and to mobilize together to collaborate. This is incredibly powerful. The technology enabled people to do something in real life. It wasn’t just about sharing pictures of food and videos of cats on social media, or wiling away hours playing Candy Crush or Angry Birds. This technology was exploited to make all of our lives a bit better as we lived through a natural disaster together. Those who were unaffected and wanted to help just had to grab their mobile device and utilize social media to find out what they could do to help. Those who were affected could get informed, ask for help or just read messages of encouragement.

Mobilization and collaboration to help work together to help others or to solve problems is an important area that I am exploring through human and technology systems.

Mobilization can be harnessed for helping organizations and groups of people solve really hard problems. Distributed computing can be combined with crowdsourcing to distribute problem solving amongst our most powerful tool at our disposal: the human brain. Projects like fold.it provide problems in a gaming context to help provide vital information for researchers who are looking at combating disease, or providing health care technology to improve our lives. These are enormous problems that have an impact on all of us. On a smaller scale, we can focus our energy and mobilize the people in our social circles to help us achieve health goals or recover from injury with the SuperBetter game created by Jane McGonigal. These are two powerful examples of how we can use technology and humanity together to solve problems.

Those of you who follow my writing know that this is an area that is important to me, even on simple tasks like test automation where I prefer human involvement in the computing work (see Man and Machine: Combining the Power of the Human Mind with Automation for more.) In the past, we have tried to outsource difficult problems to machines, and now we are learning better ways of getting the best of both worlds – the computing systems support us and do what they do well and enable us to really take advantage of collective wisdom and interests. I think we are just scratching the surface on this space.

Distributed collaboration to solve really hard problems is an area I am looking into more.

I’ve done a lot of work with mobile applications, and many of you are familiar with my book and course on testing mobile applications. I have trained hundreds of people, and many more have read my ideas about testing mobile apps or web experiences, but that is only part of the picture, and I do a lot more in this space than my public work suggests. To create a great mobile experience, we need vision from business leaders on how they want to use the tech – are they merely supporting it, or are they embracing mobile technology to transform their interactions with the people they are trying to help? Are they looking at mobile as something they are forced into, or are they looking to it as a new area to help increase revenue and loyalty? If business leaders are reluctant, that vision (or lack of vision) will make its way all the way down through the project, and ultimately in a poor customer experience. On the other hand, a great mobile vision is only as good as the technology that was chosen, the design of the application, and the quality of the customer experience. I have been helping organizations to create great mobile experiences in each of these areas.

A quality mobile experience requires great vision, careful choice of technology, a design that engages customers, and is reliable for people who are on the move in the real world. That reliability also depends on great design, programming and testing. That quality experience can’t be tested in at the end, so many organizations are asking for my help in other areas, such as a mobile strategy from an executive level, how to choose the best mobile technology to fit that vision, what areas need to be addressed in mobile design, and then quality practices in programming and testing. This is a fascinating area to work in, because there are many more areas to be aware of than we are used to in software development.

A fantastic mobile experience from project vision, design and execution on down to you, the person holding the device, can make your life easier, but a poor quality experience can ruin your day. I am learning how to improve this experience and I want to show you how you can too.

Some of you have wondered why I am talking about things like gamification. I am less concerned about the gaming aspect, I am more concerned with what lessons we can learn from this field with regards to collaboration and finding meaning in what we do. Modern knowledge work can be difficult to deal with over time. If the power goes out, all our work disappears, so many struggle to find motivation and meaning in their work and careers.

To me, gamification is just one of several potential models of engagement, and we can use it in different ways. If you are in a job that is difficult and you are losing hope, don’t be threatened if I talk about gamification. If making your work more like a game fits your context and your personality, as well as the people working with you, then yes, we might look at creating some sort of Alternate Reality Game (ARG). Always know I would never force that if you weren’t interested, or if it wasn’t appropriate. However, I may use mechanisms that I have learned from game designers to help with areas of work that are difficult, feel hopeless and don’t have meaning. If I do it correctly, you won’t recognize it as a game – I won’t just put up superficial gold stars and leaderboards, or worse, trivialize the important work that you do. I may however, collaborate with you to create something to help you get more meaning in what you do using engagement or other concepts I have learned from games.

That is vital in human and software systems that people work with. Can we make this activity or program engaging so they want to use it more? Can we design the system to not only solve the problems of an organization, but also to help reinforce meaning in what people do? Gamification is an interesting and powerful area of research, with a lot of potential for good, but it can also create harm. I am carefully researching how I can use this in my own work, because it is one mechanism that I see to help do something more for us.

Studying engagement models and finding and experiencing meaning in the things we spend our days working at is important and I am spending more time looking at how the intersection of software and people systems can help.

Design principles are another area of research and problem-solving for me, which are often under the umbrella of UX (User Experience). Creating great software experiences can really help us since we interact with it, or it affects us indirectly in everything that we do. A better software or computer system experience has an enormous impact on our lives. When they go wrong, they can really cause problems, but a simple, elegant solution can bring joy. User experience and design in an era where wireless and sensor technology is common, touch and gesture interaction on different technology with different screens is hard enough. What do we do when nanotechnology and other distributed or pervasive systems become much more common? I love the research and work in this space, and it is a part of what I do on projects.

The challenges we have are fascinating, so product management and product design are areas of project work for me, and what I am increasingly spending time on in my spare time.

Some of you have heard me talk about health projects. One of the most rewarding projects of my career was working on a medical program for mobile devices. It was great to try to break new ground with new technology, and determine how we could make health-care professionals lives easier, and to enable them to provide better patient care. My Mother still works as a medical professional, it is a calling, and we tease her that if she refuses to retire, she’ll pass on “in harness”. She is absolutely fine with that, she is committed to her work and patients, and takes courses every year on areas that interest her, and how to better use technology in her own work. She has passed that down to me, and finally as a professional, I have had some chances to help create better software for medical professionals. I enjoy working on medical software because I can see how we are contributing to actually make people’s lives better. When we do it right, we enable others to do great work, solve difficult problems and help real people. It’s easy to find meaning when your work has an impact on others, and we can do so much better with technology and health than we have been.

Systems that help us live more healthy lives are an area of keen interest for me, and I am interested in mobile, games for health, distributed computing, crowdsourcing and all sorts of things in that space. Healthcare professionals like Anna Sort inspire me with their creative and innovative ideas that they turn into action, and programs like Strokelink to help stroke patients using mobile technology are great.

I’m also interested in how we can create software for health professionals that is easier to use, more reliable, and enables them to focus on patients and not fight with systems that don’t take them and their unique context and work as well as the environment they are working in into account.

Finding ways to use software and related technology in health care and health research is another area of huge interest for me.

So there you have it. Watch this space for more of the above topics on how we can explore the intersection of people and technology to help design better lives for ourselves.

A Bad Mobile Experience is Bad Customer Service

As a travelling consultant, I get insight into a lot of organizations. One theme that I see over and over is a lack of understanding about mobile experiences among decision makers and technical teams. When it comes to interpersonal or written communication, companies have sensible rules and practices about making that exchange great. You’ll hear or read slogans about treating the customer right, or to go beyond and satisfy and impress them. Most organizations have great alignment on that message, and when I walk into an office, I am greeted by friendly security and front office staff who smile, are pleasant and help me get to where I need to go. They want all of us to have a great first impression, so they invest in human-friendly lobbies with art, comfortable furniture, and great lighting. This extends to email and voice communications as well. People try to be professional, pleasant, and make me feel welcome as a customer or consultant. However, that is rarely my first impression of that organization. For me, and millions like me, I get my first impression of that organization through their mobile experience.

In many cases, that mobile experience is the opposite of their interpersonal customer service. They fail to realize that a bad digital experience is just plain old bad customer service. It is the virtual equivalent of a rude call center employee, or an office administrator who tells me to go f— myself when I walk through the door. Instead of feeling valued by the organization, my mobile experience feels like they don’t care. They make me feel confused (what does this company do?), they make me feel frustrated (I can’t solve the problem I need to sort out!) and that they don’t value my time (why do I have to gesture so many times and spend so much time to do a simple task?)

These organizations would be horrified if I was flipped off when I walked in the door, but they have no problem making me feel just like that when I try to interact with them virtually on my mobile device. And they don’t seem to have a problem with it. On the other hand, organizations that realize great customer service extends to digital experiences have alignment on their customer-first values. Instead of worrying about mobile frameworks and handsets and technology development, they seek the solutions that provide a great customer service on virtual mediums. Thankfully, that means we have a lot of examples on how to do it well.

Here is an example of contrasts: airline mobile experiences. I won’t name names, but I will describe 3 different mobile experiences and the technology they are using to either create great customer service, or do the digital equivalent of flipping us off.

I travel a lot, and when I am travelling, I need the following at a minimum:

  1. Ease of use (so I can get my information quickly when under pressure on a trip)
  2. My booking details stored: confirmation number, flight numbers, seating details (this eliminates printing out paper that often gets out of date)
  3. Access to my booking details when I don’t have network connectivity (when you travel, you are frequently without wifi or cellular data, particularly if you don’t want to purchase an expensive data plan during a short trip)
  4. Up to date flight information when I am connected to a network (so I can get out of jams when there are delays or cancellations)
  5. Ability to book or modify or cancel flights
  6. Simple contact to customer service if all else fails on my own

Let’s look at three different mobile experiences from three different airlines:

  • App 1: a native mobile application
  • App 2: a hybrid mobile application
  • Web 1: mobile optimized web-only access

How do they stack up?

App 1 (native):

  1. Ease of use: incredibly easy to use, and it takes 2 gestures to get my current flight information. It takes about 15 seconds to tap the app and get all the info I need to fly
  2. Flight details stored: all my flight information is stored so I don’t need to search elsewhere
  3. Offline access: this app not only displays all my information when I don’t have networking or wireless access, but if I am not connected, it provides a warning message and tells me the data may be out of date. This is useful in cabs, in areas of an airport without connectivity (such as in security) or in an aircraft while in airplane mode so I can check my next flight if I have a connection
  4. Information updates: this app lets me know of gate changes, delays, and even lets me check on in-bound aircraft status and other dependencies. When there are problems, I and others with the app know before official announcements are made, which gives us a jump on the competition for rebooking or making alternative arrangements. This app has helped me get to a client site or get home on time on a number of occasions.
  5. Flight bookings: this isn’t easy to do on mobile devices, but with a few taps and gestures, you can get the job done without feeling frustrated
  6. Easy contact to a real person for help: one or two taps and I am speaking to a customer service rep who can help with a problem I can’t sort out with the app

App 1 overall customer experience: great!

This app has really improved my flying experience and I am growing to like this airline more over time.

App 2 (hybrid – combo of web and native technologies):

  1. Ease of use: not bad, but it is a bit clunky and doesn’t respond as smoothly to input gestures as the native app. I can’t zoom in on some screens, and on others, it takes me out of the app to the website, which is irritating. It feels quite slow, but I don’t have to do a lot of inputs, I just feel like I am waiting
  2. Flight details stored: This is a thin-client app (not taking advantage of local storage that hybrid apps provide), so I have to store my booking reference in a note, leave the app, copy it from a note, paste it in, and then wait for it to load my details. This is frustrating and takes a lot of time. There is no excuse for overlooking this with a hybrid app.
  3. Offline access: The app will not function without a good wireless connection. That means it is useless in many areas of an airport. If I want to check my flight number for a connection while the app is in airplane mode, it crashes. I have to take screenshots of details when they are available as a workaround.
  4. Information updates: The app does not provide updates. I have to navigate to the airline website or airport website and search for details on the flight. This is too time consuming and is frustrating. I get no information advantages and have to get in line with everyone else if there is a delay or cancellation
  5. Flight bookings: Not bad. Nice interface, and few gestures to get the job done. It just feels slow compared to a native app.
  6. Easy contact to a real person for help: I have to do a lot of navigating, and then I get redirected to their corp web site which is slow, cumbersome and frustrating

App 2 overall customer experience: poor.

Every time I use the app I get frustrated and I project that frustration on the airline. In one case, I was having trouble checking in at a kiosk, so I opened up the app. It gave me a cryptic error message that made me feel like my flight had been cancelled. I had to stand in a line up for a half hour to find out from a human to look into the problem and sort things out. This app requires workarounds (save my booking reference in a note or search for an email confirmation and screen shots of up to date data) to be even useful when I fly. They chose hybrid to get cross platform support, yet they don’t even take advantage of the affordances of a hybrid app.

Web 1 (mobile web site):

  1. Ease of use: horrible. I have to open a web browser, and to just enter in their URL is over 20 taps! I probably don’t have 20 taps in a month of using the other apps in total. Once I enter in their URL in my device and fix typos, 30 seconds has passed. I am then redirected to a mobile optimized web site. I can’t get both my flight status and my booking information in the same place, so to get the same information I get with 2 taps from a native app takes me over 50 taps and gestures and can take 2-3 minutes, under ideal conditions. Their image carousel on each page takes forever to load, and gets in the way of my interaction.
  2. Flight details stored: As a web app, there is no local storage, so again I have to store my booking reference in a note, leave the web browser, copy it from a note, paste it in, and then wait for it to load my details. This is frustrating and takes a lot of time.
  3. Offline access: None. I can’t do anything without a good wireless connection.
  4. Information updates: No updates. I have to go to a different website for that, and tap away on the URL, and experience the same pain.
  5. Flight bookings: Not bad. Nice interface, and few gestures to get the job done. Again, it feels slow compared to a native app and there are some inconsistencies from screen to screen.
  6. Easy contact to a real person for help: I have to go to their corp web site, which means I usually have to find the option to go to their full web site (a tiny URL at the bottom of some of the mobile screens.

App 2 overall customer experience: Rage inducing.

When this app lets me down in an airport because it takes too long to get anything done, I look longingly at the competition counters across the hall. This experience is beyond useless and it causes me to lose faith in the organization as a whole. If this is so painful, how is the flight? Also, I found that staff members have very little faith in the mobile experience. Even though I had a PassBook ticket that was valid, they reprint a hard copy when I try to board the aircraft because they “don’t trust the mobile app”. PassBook integration is one thing they do well, but people get so frustrated with an experience that doesn’t fit the needs of customers and staff on the front lines hear about it and try to adjust.

So whose app do I use the most? App 1 of course, and I also fly with them the most. I get a great customer experience with their mobile app, and they also do a decent to please us in their interpersonal interactions. The airlines that supply App 2 and Web 1 actually have better interpersonal interactions – they are friendlier and more helpful, but the mobile digital experiences are not convenient, so I don’t fly with them as often. This has less to do with the technology they have each chosen, but in how they have chosen to implement it and whether they are making technical decisions or customer-serving decisions in how they create mobile experiences.

A great customer experience that enhances convenience goes a long way. In fact, I will put up with less than ideal interpersonal interactions with a company if their mobile experience is convenient and makes my life easier. Next time you are looking at your mobile experience, no matter what the technology, ask the question: are we creating a great customer experience with our technology as well as with our people? The extent to which you use mobile technology to address that means much more to your customers than just “going mobile” and putting something out there. In some cases, no mobile access is better than one that makes people hate your company.

In an upcoming post, I’ll talk about ways our hybrid and web-only airline friends can improve their mobile customer service.