top of page

Carta de Derechos de la IA: Protección de la dignidad humana y la autodeterminación en la era de la inteligencia artificial.

Un marco para los derechos de las personas con discapacidad, la neuroética y el desarrollo de la IA centrada en el ser humano.

Desarrollado por la Fundación Scott-Morgan. Versión 1.0 | Noviembre de 2024

Nuestra creencia fundamental

La comunicación es la base de la dignidad y la seguridad humanas. Sin la capacidad de comunicarse, una persona no puede defender sus necesidades, protegerse del daño, acceder a la educación, establecer relaciones ni participar plenamente en la sociedad. Cuando una enfermedad o discapacidad priva a alguien de su voz, la tecnología debe restituírsela, no por caridad, sino como un derecho humano fundamental.

Cada persona es la máxima autoridad sobre su propia experiencia, cognición e interacción con la inteligencia artificial. Creemos en construir sistemas de IA CON las personas, especialmente aquellas con discapacidad, no PARA ellas. La tecnología debe potenciar la capacidad de acción humana, nunca disminuirla. Rechazamos cualquier enfoque que presente a la IA como un sustituto del juicio, la autonomía o la dignidad humanas.

La comunicación no es un lujo. Es esencial para la supervivencia, el aprendizaje y el desarrollo. Nos comprometemos a democratizar la tecnología de la comunicación porque el silencio no es solo aislamiento; es borrado.

Preámbulo

Nosotros, la Fundación Scott-Morgan, junto con nuestros socios, incluyendo a Young AI Leaders, y la comunidad global de personas con discapacidad, establecemos esta Carta de Derechos de la IA para proteger la dignidad, la autonomía y la autodeterminación fundamentales de todas las personas que interactúan con sistemas de inteligencia artificial. Reconocemos que las personas con discapacidad suelen ser las primeras en entrar en contacto con las tecnologías emergentes de IA y, por lo tanto, deben ser el centro del desarrollo de marcos éticos que protejan a todas las personas.


Esta Declaración de Derechos abarca todo el espectro de la interacción con la IA, desde sistemas de escucha ambiental y entornos multiagente hasta avatares y tecnologías de aumento cognitivo. Rechazamos los enfoques extractivos que explotan las experiencias humanas sin consentimiento y nos comprometemos a prácticas de desarrollo equitativas que respeten la diversidad de formas de ser.

Declaración de Derechos

1. The right to communicate, be heard, and remain silent
Every person deserves a reliable means of expression suited to their abilities and circumstances, along with sufficient time and support to use it. Communication systems should accommodate unusual speech, pauses, fatigue, incomplete phrases, and changes in how someone controls an interface. They should also respect a person's decision to stop, withhold an answer, or say nothing at all.


Silence, delayed responses, and inconsistent input must never be treated as consent. Systems should make room for humor, anger, disagreement, ambiguity, and an individual's distinctive way of speaking, even when those forms of expression are less convenient to predict or process. 

​

2. The right to informed partnership and education
People deserve an understandable account of what their AI system does, what it cannot reliably do, and what may change as models or services are updated. This includes information about voice cloning, avatars, ambient recording, personal memory, data-sharing arrangements, and the roles played by different agents or service providers.

 

Education and support should continue after onboarding. Explanations, trials, training, and options to withdraw must be available through the person's own communication method, with enough time to make an informed decision. Important limitations should be explained when they matter, rather than buried in documents someone may be unable to navigate.

​

3. The right to usable control over AI and its agents
A person should be able to pause, redirect, correct, or stop an AI system before it speaks or acts
beyond their instructions. In multi-agent environments, they should know which agents are active, what each has been authorized to do, what information they exchange, and when the system is acting outside the immediate conversation. Where the system permits, individual agents should be adjustable or disabled without forcing the person to abandon all assistance.


Control has to work under real conditions. A button that requires precise movement after a person's control has deteriorated offers little protection, and a refusal that takes several minutes may arrive after the conversation has moved on. Providers should test whether people can exercise their choices reliably, with the time, effort, and physical access actually available to them. Actions with lasting consequences require authorization and a practical route to human intervention.

 

4. The right to authorship and authentic self-expression
A person retains authority over the meaning of messages communicated in their name, even when AI helps find words, completes a sentence, retrieves a familiar expression, or renders speech in a synthetic voice. People should be able to reject every suggested response, begin from a word or fragment of their own, correct an interpretation, and express something the machine did not anticipate. They may also choose to delegate routine language without surrendering control over more consequential speech.


Selecting a model-generated sentence does not establish why it was selected. Someone may genuinely prefer it, tolerate an approximation to stay in the conversation, or accept it because correcting it would consume too much energy. Systems should preserve those distinctions wherever they affect consent, learning, attribution, or the representation of personal beliefs. Fluency must never be used as a reason to erase a person's distinctive language or dissent.
 

​

5. The right to change without being overwritten
Personal AI systems learn from a person's history, but that history can include suggestions the same system previously supplied. Over time, accepted approximations may be mistaken for deeply held preferences, and repeated model choices may gradually narrow the language a person is offered. We call for safeguards against this form of authorship drift, especially where acceptance, speed, or user engagement becomes a signal for future personalization.


People should be able to review and correct inferred preferences, distinguish their own statements from machine-generated proposals, and change their mind without being held to an earlier version of themselves. Evaluation must look beyond a single satisfactory response to what happens across months of use, model updates, and changes in the person's ability to communicate.

​

6. The right to consent over voice, likeness, and personal identity
A person's voice, face, avatar, personal history, and recognizable manner of expression carry their identity. Consent to use a communication service should never be treated as blanket permission for research, model training, demonstrations, advertising, commercial reuse, impersonation, or future uses that have not been explained. Each materially different purpose needs an understandable choice, including the choice to refuse without losing access to an otherwise available essential service.


Permission should be recorded clearly, reviewed when circumstances change, and withdrawable to the extent technically and lawfully possible. When a representative is needed, their authority and its limits should be documented; a caregiver's preferences should not quietly replace the person's own recorded decisions.
 

​

7. The right to provenance without losing human authorship

People should be able to understand how a message was made and who authorized it. That requires answers to four separate questions: Where did the language come from? What did the person approve? How was it presented or spoken? Who was being represented, and on what authority?
 

A synthetic-audio watermark may establish that software generated the sound, while saying nothing about who chose the words or intended the message. The same distinction applies to translated text, AI editing, and messages delivered by avatars. Provenance systems should reveal the machine's contribution and the limits of what can be verified, without inviting others to discount someone's communication simply because technology carries their voice.

​

8. The right to accountable representation and recipient choice
When an AI agent contacts another person on someone's behalf, the recipient deserves to know who is responsible for the approach, what authority the agent has, and how any information provided will be used. A professional title, organizational signature, or human-sounding message should not imply that a person personally wrote or reviewed something when that has not occurred.


People using assistive AI also deserve verification methods that respect disability and privacy. They should not have to speak naturally, appear on video, or disclose a medical condition to establish that they authorized a message. Both sides of an AI-mediated exchange need a way to question its authority, correct the record, and reach an accountable human when necessary.

​

9. The right to privacy, data justice, and fair use

Communication histories can reveal relationships, emotions, medical circumstances, intellectual work, and details a person never intended to make public. People should know what information is collected, where it is stored, who can access it, how long it is retained, and whether it contributes to model development or commercial products. Data obtained for essential communication should not silently become a research resource or a transferable commercial asset.


We support meaningful rights to inspect, correct, export, restrict, and request deletion of personal information, alongside honest explanations of any technical or statutory limits. Consent for care or communication must remain separate from permission for research and secondary use. Communities whose language or speech data make AI development possible should participate in decisions about access, recognition, and the benefits of that work.

​

10. The right to accessibility, linguistic diversity, and cultural respect

AI must work for people who fall outside the assumptions built into mainstream products. That
includes those with dysarthric speech, changing motor ability, uncommon languages or dialects, and communication practices that do not fit a system's training data. Accessibility should be considered throughout design and testing, with alternative input methods and support that can adapt as needs change.


Systems should respect cultural and personal differences without imposing a single standard of fluent, agreeable, or supposedly normal expression. When recognition is uncertain, the system should say so and offer a usable route to correction. A model's inability to interpret an individual's speech provides no basis for judging that individual's intelligence, capacity, or credibility.

​

11. The right to co-creation, recognition, and fair participation

People who depend on emerging technologies should have meaningful roles in deciding what gets built, which questions are studied, and how success is measured. Their lived experience can shape scientific methods and engineering decisions, and participation should extend beyond product demonstrations or consultation after major choices have already been made.


Researchers and developers should agree clear terms for contributions, attribution, compensation where appropriate, and any intended commercial use of data or creative work. AI assistance should not erase the human author's or inventor's contribution. The ownership and licensing of particular innovations may depend on applicable law and agreements, which makes transparent terms especially important before work begins.

 

12. The right to continuity, portability, and exit

Someone whose ability to communicate depends on a particular device, speech model, or cloud service faces a serious risk when that service changes or disappears. Providers should plan for transition, give meaningful notice of foreseeable disruptions, and support access to personal records, settings, consent history, and other material that can lawfully and technically be transferred.
 

A person's voice and communication history should not become a commercial lever that prevents them from changing products or providers. We advocate interoperable systems, documented exit arrangements, and practical support when technology must be replaced, while being clear about the limits of transferring proprietary models or licensed voices.

​

13. The right to decide one's digital legacy

People should be able to decide what happens to their recorded voice, likeness, avatar, personal
model, and communication history if they lose the ability to communicate or after they die. A stored recording, a memorial playback, continued research use, and the generation of new sentences in someone's voice involve different kinds of permission. They should be presented as separate choices, made and recorded while the person can express them.


A person may appoint a custodian for defined purposes, including preservation, restricted access, or deletion. If instructions are missing or ambiguous, a system should not assume permission to generate new material in the person's name. Retention, access, deactivation, and deletion procedures should be consistent with the person's documented wishes and applicable obligations, with clear explanations of what can actually be carried out.

​

14. The right to challenge harm and demand accountability

People need an accessible way to challenge false attribution, unauthorized voice or likeness use, harmful model updates, incorrect transcriptions, improper data use, and actions taken by agents beyond their instructions. A complaint process is inadequate if a person cannot use it with the communication method available to them or cannot learn who is responsible for making a correction.


Developers and deployers should maintain traceable records appropriate to the risk, explain significant failures, and provide timely routes to correction and remedy. Independent scrutiny should include disabled people in positions of influence, with evaluations that examine long-term use, unequal performance, and the practical cost of refusal. The Foundation will distinguish the safeguards already available in its own systems from those still being developed or tested.

​

15. The right to make consequential decisions without AI coercion or misrepresentation

AI systems must take particular care when a person uses them to discuss medical treatment, continued ventilation, advance care plans, or medical assistance in dying where it is lawful. Physical dependence on an assistive device can make the cost of correcting a machine unusually high, while a clinician or caregiver may understandably look to that device for a clear answer. The system's wording, defaults, omissions, and suggestions can therefore influence what is heard as the person's choice.
 

A person whose eye movements have become inconsistent might appear to answer “yes” to a question about continued ventilation. If software converts that movement into a certain response, clinicians may hear consent that was never established. Likewise, a statement such as “I cannot bear this anymore” must not be silently rewritten as a request to withdraw treatment.

The same protections must respect the right of a person with decision-making capacity to ask difficult questions and receive appropriate information. A suicidal crisis calls for responsive human support and safeguards against harmful encouragement. An informed discussion with qualified clinicians about lawful treatment choices or end-of-life care requires a different response. Disability, unconventional speech, or the loss of a reliable motor channel cannot alone determine capacity.
 

High-stakes systems should preserve uncertainty, make assumptions visible, and support accessible confirmation wherever a contemporaneous decision can be established. When communication has become unreliable, previously documented instructions and properly authorized clinical decision-making processes require careful consideration. AI must not invent a current preference, treat a caregiver's inference as the patient's own words, or optimize for agreement when someone's life may depend on the answer.

Core
Preamble
Declaration
Implementation

Marco de implementación

These rights concern much more than the behavior of an individual language model. Their protection depends on accessible interfaces, consent and data practices, the objectives used to train and reward systems, responsible deployment, and human institutions prepared to act when technology fails. The Foundation asks its partners and other organizations to evaluate those elements together rather than treating a policy statement or a favorable benchmark as sufficient evidence of safety.

 

In our own work, we will use these rights to inform product decisions and research protocols, while identifying where a safeguard remains incomplete. We intend to test whether people can refuse, correct, and stop AI assistance within the physical and temporal constraints of their lives; whether their personal models remain faithful without trapping them in the past; and whether agent messages can be traced to an authorized person. The resulting evidence should include mistakes, limitations, and disagreements, alongside improvements.

 

We also call for rights-impact assessments before and after significant deployments, meaningful consultation with disabled people, accessible reporting of incidents, independent evaluation with disability-community participation, strong data security including encryption appropriate to the system, and clear responsibility for remediation. Measures such as speed, user satisfaction, acceptance rates, and engagement can reveal useful aspects of a product, but none establishes on its own that the person remained the author or that the system respected their wishes.

Clinical Implementation Standards

Estándares de implementación clínica

Complemento de los Derechos 4 y 5, adaptado de las directrices del Programa de Comunicación Aumentativa Fishman para la ELA.

Propiedad y control de los datos de voz

Todos los datos de la voz clonada siguen siendo propiedad del usuario. La tecnología que contiene la voz clonada debe ser propiedad del usuario o de su representante designado, quien deberá controlarla. Cuando se preste o transfiera tecnología, el usuario o su representante deberá documentar y conservar un plan por escrito para la eliminación completa de la voz clonada al finalizar su uso.

Normas de consentimiento informado

El consentimiento para la clonación de voz debe incluir una explicación clara sobre la propiedad de los datos, los derechos de uso y las preferencias posteriores al fallecimiento. Estas preferencias deben revisarse anualmente o tras cambios significativos en el estado de salud, y conservarse en el sistema de documentación que utilice el usuario o su red de apoyo.
Gestión de la voz póstuma

Los usuarios tienen derecho a designar un custodio principal para su clon de voz y a especificar de antemano quién puede acceder a él, bajo qué condiciones y para qué fines. Las decisiones deben contemplar el uso conmemorativo, la creación de nuevos mensajes, la transferibilidad y la eliminación permanente. La Fundación recomienda que estas preferencias se documenten formalmente y se compartan con los custodios designados.

Nuestro compromiso

This Bill of Rights will be reviewed at least annually, and sooner when significant evidence or
technological changes warrant it. We will seek input from people who use assistive communication, researchers, clinicians, families, disability advocates, and younger people who will grow up alongside these systems. Revisions should carry a date and an explanation of the changes, so that a later version does not silently rewrite the Foundation's earlier commitments.

Commitment

Nuestro compromiso

The Scott-Morgan Foundation exists to expand the possibility of living, contributing, and creating with severe disability. We will judge the technology we build and the partnerships we enter by what they make possible for the person using them, including the ability to refuse, dissent, and become someone different from the person a model has learned to predict.
 

Dr. Peter Scott-Morgan's belief in the right to thrive remains our starting point. A machine can perform extraordinary amounts of work on someone's behalf while the purpose, judgment, and voice of that work remain theirs. Our responsibility is to make that distinction visible, protect it when the stakes are highest, and keep listening to the people who can tell us when we have failed.

Acknowledgements

Expresiones de gratitud

Esta Declaración de Derechos se elaboró en colaboración con personas que viven con ELA/EMN y que están probando tecnologías de asistencia de vanguardia, así como con defensores de los derechos de las personas con discapacidad en todo el mundo. Un reconocimiento especial merecen innovadores como Bernard, cuya experiencia personal y conocimientos técnicos demuestran que las mejores soluciones provienen de quienes más las necesitan.

La Fundación agradece profundamente la labor clínica fundamental de John Costello y del Programa de Comunicación Aumentativa Jay S. Fishman para la ELA en el Hospital Infantil de Boston. Sus Principios Rectores sobre la Clonación de la Voz y su Integración en las Tecnologías de Comunicación Aumentativa sentaron las bases clínicas de nuestro marco, en particular en lo que respecta al consentimiento informado, la gestión de la voz póstuma y las normas de protección de datos que hacen efectivos estos derechos. Esta Declaración de Derechos se fundamenta directamente en dicho trabajo.

Evolution and Review
bottom of page