BDVA Algorithmic Transparency

Question Title

* 1. Are you a BDA member?

Yes

Question Title

* 2. Is your organization

an SME (small & medium enterprise)

a corporate (industry, media, services)

a corporate (consulting)

an RTO (research & technology organization)

a governmental body

Other (please specify)

Question Title

* 3. What would be your organization's interest in algorithmic transparency?

	None	Somewhat	A lot
Legal, eg compliance with GDPR	Legal, eg compliance with GDPR None	Legal, eg compliance with GDPR Somewhat	Legal, eg compliance with GDPR A lot
To create trust with customers	To create trust with customers None	To create trust with customers Somewhat	To create trust with customers A lot
Internal quality control and technical considerations	Internal quality control and technical considerations None	Internal quality control and technical considerations Somewhat	Internal quality control and technical considerations A lot
Corporate social responsibility	Corporate social responsibility None	Corporate social responsibility Somewhat	Corporate social responsibility A lot
Commercial, to provide services or as a differentiator	Commercial, to provide services or as a differentiator None	Commercial, to provide services or as a differentiator Somewhat	Commercial, to provide services or as a differentiator A lot

Other (please specify)

Other concepts
Alongside 'transparency', we find many notions for other concepts. Some of them may be more relevant to you than 'transparency'.

Question Title

* 4. Which of these related terms do you think are most relevant?

	Not so relevant	Neutral	Relevant
Liability	Liability Not so relevant	Liability Neutral	Liability Relevant
Accountability	Accountability Not so relevant	Accountability Neutral	Accountability Relevant
Explainability	Explainability Not so relevant	Explainability Neutral	Explainability Relevant
Responsibility	Responsibility Not so relevant	Responsibility Neutral	Responsibility Relevant
Accuracy	Accuracy Not so relevant	Accuracy Neutral	Accuracy Relevant

Other (please specify)

Value chain
Typically, data is processed in value chains. Every part of the chain may use algorithms for the processing. So it is not only the end user that may require transparency.

Question Title

* 5. Can you identify examples where end-user transparency requirements create a 'waterfall effect', where they lead to transparency requirements earlier in the value chain?

Question Title

* 6. Can you give examples of situations where a value chain partner requested transparency from your side?

Existing initiatives
There is a couple of initiatives that already (partly) address transparency. A brief summary:

France

Digital Republic Bill
TransAlgo

Netherlands

VWData
Ministry of Economic Affairs (benchmark)

Europe

H2020 projects like R3COP
AI for People (forum)
Working group on legal questions of robotics

Outside EU

AI R&D Guidelines (Japan)
Whitehouse report on future of AI
IEEE ethically aligned design

Question Title

* 7. Do you know of other existing (national) initiatives that address algorithmic transparency?

Question Title

* 8. How do you think the topic is best addressed at EU level?

In an H2020/FP9 project

As an added aspect in other topics

On the EU policy level

Not at all

Other (please specify)

Legal aspects
One driver for Algorithmic Transparency is the GDPR, for instance article 12: provide information on processing in transparent form, meaningful information; and article 22 on Automated individual decision-making, including profiling

Question Title

* 9. Would your organization have uncertainty regarding legal aspects of transparency, and if yes, which ones?

Which minimum level of algorithmic transparency is required

What internal systems and processes are in scope

Whether our organization's processes can be seen as 'individual decision making' or profiling

None

Other (please specify)

Technical aspects

Algorithmic transparency requirements raise many technical issues. Although transparency can help to improve quality, there are limits because of complexity of algorithms. There may also be risks in terms of vulnerability and IPR. The question is also what timing we should adopt when we want to standardize aspects of transparency.

Question Title

* 10. What do you think are the main technical challenges?

To include contextual information (like training data, design & test process)

To handle complexity (interpreting machine learning, or dependencies in processing chains)

To protect IPR

Other (please specify)

Question Title

* 11. Which parts of an algorithm should be transparent?

The algorithm design process (requirements, goals, team)

The algorithm logic itself

The training data collection process

The training data description

The input data that is used in a specific situation

Other (please specify)

Question Title

* 12. Do you think that algorithmic transparency should be standardized?

No, this is not needed

Yes, in an industry bottom-up approach (eg, 'best available techniques')

Yes, in a more formal way, but not now

Yes, in a more formal way, and we should start now

Other (please specify)

Business

There may be positive and negative business impacts.

Question Title

* 13. Which business aspects of algorithmic transparency do you expect in your business?

An additional service proposition (toprovide auditing or certification services)

Being transparent can be part of the marketing mix or our company profile (eg, Corporate Social Responsibility)

Better quality: transparency uncovers potential flaws that would otherwice go unnoticed

There will be costs related to certification, compliance, standardization, ...

Profiling or customer segmentation becomes very difficult or will create adverse effects

There can be liabilities when transparency makes shortcomings visible

Other (please specify)

Societal implications

Transparency does not automatically create trust. And the knowledge level of the audience to whom transparency is communicated matters a lot. Expectations and requirements from society influences businesses and technology, and the other way round.

Question Title

* 14. What is the relevance of algorithmic transparency for the adoption of AI / machine learning in society?

Highest importance

Important

Not very important

Not important

Question Title

* 15. What would be the biggest societal risks when transparency is not addressed in ways that are understandable for the end users?

People becoming algorithm adverse (not trusting anything anymore)

People trust AI/ML too much, and ignore common wisdom or safety

Growth of the digital divide; people who know how to work with algorithms, and people who are clueless

Not a real risk

Other (please specify)

Question Title

* 16. Finally: recommendations - what are good actions?

	Useful	Somewhat useful	Not very useful	Useless
Invest in creating benchmarks, libraries, good practices, ...	Invest in creating benchmarks, libraries, good practices, ... Useful	Invest in creating benchmarks, libraries, good practices, ... Somewhat useful	Invest in creating benchmarks, libraries, good practices, ... Not very useful	Invest in creating benchmarks, libraries, good practices, ... Useless
create standards (describing transparency, levels of transparency, etc)	create standards (describing transparency, levels of transparency, etc) Useful	create standards (describing transparency, levels of transparency, etc) Somewhat useful	create standards (describing transparency, levels of transparency, etc) Not very useful	create standards (describing transparency, levels of transparency, etc) Useless
research to make complex algorithms simpler and transparent in an understandable way	research to make complex algorithms simpler and transparent in an understandable way Useful	research to make complex algorithms simpler and transparent in an understandable way Somewhat useful	research to make complex algorithms simpler and transparent in an understandable way Not very useful	research to make complex algorithms simpler and transparent in an understandable way Useless
an 'information leaflet' system that summarizes algorithm features for end users	an 'information leaflet' system that summarizes algorithm features for end users Useful	an 'information leaflet' system that summarizes algorithm features for end users Somewhat useful	an 'information leaflet' system that summarizes algorithm features for end users Not very useful	an 'information leaflet' system that summarizes algorithm features for end users Useless
put emphasis on 'algorithm and data literacy' education	put emphasis on 'algorithm and data literacy' education Useful	put emphasis on 'algorithm and data literacy' education Somewhat useful	put emphasis on 'algorithm and data literacy' education Not very useful	put emphasis on 'algorithm and data literacy' education Useless

Other (please specify)