Human-Centered, Robot-Driven: Ethical Considerations for ML in Design

Cyborg face, generated by Midjourney

UPDATE 2.6.23—I’ve decided to correctly refer to these systems using their actual technologies (i.e. ML—Machine Learning) rather than the market-speak and false narrative of AI (Artificial Intelligence). The article has been updated accordingly.

Modern ML systems like ChatGPT and Midjourney changing how we design, and how we think about design today and in the future. This comes at a cost. If we’re not willing to play this game right we have no business playing it at all. Below I discuss some of the tools used today, some of the issues we’ve seen with these systems, and how we can work together to have our ML-generated cake and consume it too.

At the end of the article, I’ve listed just a few of these systems already in play today.

What are these ML thingamabobs anyway?

Thingamabob, generated by Midjourney

In a nutshell, systems like ChatGPT and Midjourney can generate human-like output (e.g. text and images respectively). Their models are trained on large amounts of existing data and can generate new, derivative content based on said data.

While these models have the potential to enhance the design process, they also raise several ethical, moral, and practical issues.

Bad actors

A shady character, generated by Midjourney

One of the main concerns with ML-generated content is the potential for the proliferation of propaganda and misleading information. These systems can also be used to impersonate real people and organizations, not only spreading falsehoods but also violating privacy with the potential to cause real harm. Additionally, it raises questions about the authenticity of any and all content, and the ability to trace it back to its original author.

Bias

Unbalanced, generated by Midjourney

Additionally, ML-generated content can perpetuate bias and discrimination. ML models are only as unbiased as the data they are trained on, and if the data is biased, the generated designs will also be biased. This could lead to designs that exclude or marginalize certain groups of people, which is a major ethical concern. A good example of this is using ML to recommend people for a promotion to management. Sounds brilliant right? Remove any notion of gender, race, physical attributes, or ability…perfectly objective yeah? Amazon discovered this isn’t so. Their system was trained on résumés of the people who’d historically done well in those positions in the large tech company. Care to guess which gender dominated at the tech giant? So even without the system being aware of gender, the bias was built into the training models simply because of how things worked in the past. Bias has found its way into our judicial system, mortgage lending, resident screening, and more affecting real people’s lives—and generally not for the better.

Theft

Man in black stealing art, generated by Midjourney

Some artists have gone so far as to launch a lawsuit against some of the ML generators like Stability AI and Midjourney. They claim their rights were infringed upon by having their work (and likely millions of others) scraped illegally by these companies to train their models. 

Without the billions of pieces of work generated by these artists, the models would not be able to function and there would be no tool, but not a single artist has been attributed let alone compensated for the billions of hours taken to produce the original work.

Recognizing the problems

Weapons of Math Destruction, by Cathy O’Neil

In "Weapons of Math Destruction", Cathy O'Neil describes three checks to identify "Weapons of Math Destruction" (WMDs) which are any systems, technologies, or models used in harmful ways, often to marginalized groups. The three checks are:

1. Opacity: A WMD is opaque if it is hard to understand how it works, and if its creators are unwilling or unable to explain it. This makes it difficult for people to question, investigate, or validate the model's assumptions, biases, or decisions.

2. Scale: The more people the tool has access to, and the more it's used, (the bigger the scale) the bigger the risk of the tool harming large groups of people.

3. Damage: A WMD causes damage if it’s used to make decisions with a negative impact on people's lives and if the people who are most affected by the model are not the ones who are best positioned to understand or challenge it. This makes it difficult for people to fight back against the model's decisions or to change the model itself.

Technically Wrong, by Sara Wachter-Boettcher

Sara Wachter-Boettcher's "Technically Wrong" also highlights the importance of considering the ethical, moral, and societal implications of technology.

One of the key points they both make is the importance of using diverse and unbiased data sets when training ML models to reduce the potential for bias and discrimination in ML-generated designs. They both emphasize the importance of transparency and accountability when using ML, by being transparent about the technologies being used, and by monitoring and evaluating the ML-generated content to ensure they’re inclusive, unbiased, and not harmful.

O'Neil's WMD model highlights the importance of addressing the root causes of bias, such as the use of biased data sets, and the lack of diversity in tech companies. Wachter-Boettcher emphasizes the importance of designing technology with a human-centered approach, considering the potential consequences and impact on society when using technology, and the need to be transparent and accountable for the products they create.

What can we do?

Robot and Human Handshake”, generated by Midjourney

Much like the monstrosity that is the image above, humans and machines alike have a lot of work to do to ensure we don’t make a giant mess of everything. Several actions can be taken today when leveraging ML in our work to avoid ethical, moral, and practical problems.

If you’re a data scientist or leader:

• Use diverse and unbiased data sets: When training ML models, use diverse and unbiased data sets. This will help to reduce the potential for bias. This. Must. Be. Done.

• Consider the social and ethical implications: Consider any potential consequences and impact when building generative systems. Ask yourself how a bad actor might use this for nefarious purposes.

• Encourage ethical guidelines for ML usage: Work with industry groups and organizations to establish ethical guidelines for the use of ML.

If you’re a designer:

• Be transparent about the use of ML: Clearly disclose when ML is being used in your process and the specific ML technologies being used. This will help to promote transparency and accountability.

• Continuously monitor and evaluate generated content: Regularly monitor and evaluate the generated content to ensure they are inclusive, unbiased, and not harmful.

• Consult with experts: Seek advice from experts in ML ethics, privacy, and legal issues when implementing ML in design work.

• Invest in your education and professional development: Stay current on the latest developments and best practices in ML-based design to stay informed about the ethical and practical issues surrounding ML-based design.

Elevate artists and designers, don’t exploit them

Bots lift us up where we belong, generated by Midjourney

• Implement clear attribution and copyright policies: Clearly state how ML-generated content will be attributed and ensure that the original creator is credited for their work.

• Use ML to augment, not replace, human creativity: ML should be used to assist designers in the creative process, not replace them. This will ensure human creativity and artistic expression are still valued, and keep humans centric in the process.

• Educate artists and creators about ML: Educate artists and creators about the capabilities and limitations of ML so they can make informed decisions about how they want to use it in their work.

• Encourage collaboration between artists and ML experts: Encourage collaboration between artists and ML experts to ensure that ML is used in a way that supports and enhances the artist's vision.

• Encourage Fair Use and Open-source policies: Encourage the usage of open-source ML technologies to ensure accessibility and fairness. Transparency into the algorithms will help prevent them from being maliciously used.

• Protect intellectual property and provide compensation: Provide artists and creators with attribution and compensation for the use of their work in training models.

ML has the potential to enhance the design process, but it raises several ethical, moral, and practical issues. It’s paramount that everyone, designers, developers, leaders, and end-users alike, is aware of these issues and actively takes steps to mitigate them. This includes being transparent about how the ML models work, being accountable for the generated content, and being aware of and addressing bias in the data and generated content. Additionally, it's important to consider how ML-generated content may impact artists and creators and to work towards fair compensation and attribution for their work. By taking these steps, we can ensure ML is used responsibly and ethically, while still reaping the benefits of this powerful technology.

Sidenote: Not for nothing, the courts are literally still out on who exactly owns the output from generative systems. While OpenAI’s terms seem to indicate users own their output, the law is a lot more divided at the moment in terms of actual copyright.

And finally, it’s up to the technologists to take a bigger role in policing ourselves, and asking whether something should be done as often as we ask if it can be done, as well as how we do it.

Author’s note: This article was written with the assistance of ChatGPT and has a GPTZero score of 268.4: “text is likely human-generated”.

---

Some existing ML design and content systems:

GPT-3 (Generative Pre-trained Transformer 3): A language model developed by OpenAI, it can be used for NLP (natural language processing) tasks such as text generation, language translation, and language understanding.

Autodesk Dreamcatcher: A generative design tool that uses algorithms to generate design solutions based on design constraints and goals. It allows designers to explore a wide range of design possibilities, leading to more innovative and unique solutions.

Microsoft Sketch2Code: An ML-powered design tool that can turn a hand-drawn wireframe into a functional website. It uses ML (machine learning) to understand the design and automatically generate the corresponding code.

Midjourney: An ML-based generative design tool that can generate images and videos based on input like text prompts, or other images or videos. It's used to generate new and unique designs and art.

The Designer's Secret Weapon: How ML is Revolutionizing Web Design

Robot brains connected to screens - Generated with Midjourney

UPDATE 2.6.23—I’ve decided to correctly refer to these systems using their actual technologies (i.e. ML—Machine Learning) rather than the market-speak and false narrative of AI (Artificial Intelligence). The article has been updated accordingly.

As I write this ML (machine learning) is revolutionizing the way we approach UX (user experience) research and design. One of my biggest hopes for the technology is for it to help designers overcome the dearth of creativity in the modern web, creating new experiences that are unique, usable, and accessible.

One of the ways ML is doing this is through services like ChatGPT. ChatGPT is a large language model that can generate human-like text, which can be used to create more natural and engaging interactions between users and digital products. Imagine integrating it into existing sites to replace some intake forms. This can help humanize the web by making interactions with digital products feel more natural and personal, even conversational. Or instead of working to tweak your Google query to find the right website, just ask chat your question in plain language and get the data you're looking for directly.

Screenshot of a ChatGPT prompt to summarize this article

Another great way to utilize ML like ChatGPT is by integrating it into existing sites in the form of support, chat, and even forms. This can help humanize the web by making interactions with digital products feel more natural and personal. Imagine filling out a form that can understand and respond to your input in a conversational manner, making the process less tedious and more enjoyable. By using ML in this way, we can create a more seamless and enjoyable experience for users on the web, making them feel like they're interacting with a real person, rather than just a machine.

Here are just a few ways it's already happening today.

ML can assist designers in creating accessible experiences. ML-powered tools and plug-ins can analyze designs and identify accessibility issues, providing designers with instant, actionable feedback. This can help designers ensure their designs are inclusive and can be used by a diverse range of users.

Blind woman reading with ML-enhanced glasses - Generated with Midjourney

ML can nudge designers to expand their creativity by equipping them with tools and insights to inspire new ideas and approaches to design. ML could analyze user data and behavior, providing designers with valuable insights into how people interact with digital products more quickly.

ML-powered tools like Ando can inspire designers in generating new design solutions through the use of generative design techniques. These techniques use algorithms to generate multiple design options based on a set of design constraints and goals. This can help designers explore a wider range of design possibilities quickly leading to more innovative and unique solutions faster.

ML can work in the implementation of designs by automating repetitive tasks like alternate version generation, layout, and optimization. This can free up designers to focus on the more creative aspects of their work, leading to more efficient and effective design processes where designers spend more time on the things they love, and less on the things they don't.

Mobile app to purchase stock - Generated by Midjourney

ML can be a valuable tool for designers, providing them with new insights, inspiration, and automation capabilities that can help them create more unique, usable, and accessible experiences on the web. As designers, we should rejoice in the future as ML tools become more available (and usable) to create truly unique and usable experiences accessible to everyone.

If you have other suggestions of how ML can positively enhance modern design work drop me a line! As to the negative aspects, I'll need to address that in a follow-up post.

Author’s note: This article was written with the assistance of ChatGPT, with a GPTZero score of “81.4: text is likely human-generated”

Landing page for a window company - Generated on Midjourney by @ToggleWords