This survey is being conducted by researchers at Stanford ...yongslee/AIReg_FDA.pdf · Consumer purchase behavior prediction Medical services Online customer support Information retrieval

You are invited to participate in a survey of business application of artificialintelligence technologies, such as chatbots, image recognition, and productrecommendation programs. We expect that the survey will take about 6~9 minutesto complete.

This survey is being conducted by researchers at Stanford University and thesurvey results will be used for academic research only. Any personal informationwill remain confidential.Thank you for participating in our survey.

Artificial Intelligence Use in Businesses (A)

1


1. What best describes your role at your organization?

Owner or Partner

President/CEO/Chairperson

Other C-level Executive, e.g., CFO, COO, CTO

General/Operations Manager

Information System/ Information Technology Manager

Marketing Manager

Finance Manager

Sales Manager

Project Manager

Other (please specify)

2. Please briefly describe the type of work you do at the business for which you work.

2

3. What is the highest degree or level of school you have completed? If currently enrolled, mark the currentdegree you are enrolled in.

Less than a high school diploma

High school degree or equivalent (e.g. GED)

Some college, no degree

Associate degree (e.g. AA, AS)

Bachelor’s degree (e.g. BA, BS)

Master’s degree (e.g. MA, MS, MEng, MEd, MSW, MBA)

Doctorate or professional degree (e.g. PhD, EdD, MD, DDS, DVM, LLB, JD)

4. Which race/ethnicity best describes you? (Please choose only one.)

American Indian or Alaskan Native

Asian / Pacific Islander

Black or African American

Hispanic

White / Caucasian

Multiple ethnicity / Other

3

Now we will ask to what extent your workplace uses Artificial Intelligencetechnologies. We will be asking about 3 Artificial Intelligence technologies:

Natural Language ProcessingComputer VisionMachine Learning

AI technologies are different from robots or traditional data analysis. We will providea description of each technology in each question.


4

Natural Language Processing Use in the Workplace


5. Natural Language Processing is the technology that allows computers to process human speech ortext, or converse with humans. Examples of business processes using Natural Language Processinginclude sales chatbots on websites, customer service chatbots, automated speech transcription, voicerecognition in apps, virtual machine assistants, etc.

In the most recent quarter, did your workplace use Natural Language Processing? If so, in howmany business process(es) has your workplace used Natural Language Processing?

0 - No use

1 business process

2 business processes





7-9 business processes

10 or more business processes

Don't know

5


6. For which business process(es) has your workplace used Natural Language Processing? (Check all thatapply)

Customer service or sales chatbots

Speech recognition/transcription

Virtual machine assistants

Information retrieval/extraction

Recognition / prediction of diseases from text/speech

Sentiment analysis

Track news and information

Recruitment

Automated content creation

Machine translation

Litigation or fraud detection


6

Decreased

greatlyDecreased

slightlyThe

sameIncreased

slightlyIncreased

greatly

Notrelevantfor this

workplace

Managers

Technical workers (R&D workers, IT technicians, programmers,etc.)

Office workers (e.g., HR, accounting, secretarial workers, etc.but not in managerial positions)

Service and Sales workers (e.g., customer service, clientservice, salesperson etc.)

Production workers

7. How did the adoption of Natural Language Processing affect the number of the following workers at yourworkplace? Please respond to changes that happened because of Natural LanguageProcessing technology only.

7

Computer Vision Use in the Workplace.


8. Computer Vision is the technology that provides image-based automatic inspection, recognition oranalysis. Examples of business processes using Computer Vision include facial recognition for securitypurposes, anomaly detection using video analysis, image analysis in healthcare, delivery usingautonomous drones or unmanned vehicles, etc.

In the most recent quarter, did your workplace use Computer Vision? If so, in how many businessprocess(es) has your workplace used Computer Vision?

0 – No use

1 business process








Don’t know

8


9. For which business process(es) has your workplace used Computer Vision? (Check all that apply)

Facial recognition for security or other purposes

Video analysis for anomaly detection / inspection

Image analysis for disease diagnosis or prescription

Image analysis for autonomous vehicles/drones

Image recognition in retail stores / monitoring of inventory

Image recognition to authenticate documents (e.g. Passports, id cards)

Assisting humans in identification tasks


Decreased

greatlyDecreased

slightlyThe

sameIncreased

slightlyIncreased

greatly

Notrelevantfor this

workplace

Managers




Production workers

10. How did the introduction of Computer Vision affect the number of workers at your workplace? Pleaserespond to changes that happened because of Computer Vision technology only.

9

Machine Learning Use in the Workplace


11. Machine Learning is the technology that provides automated prediction and recommendationusing computer algorithms. Examples of business processes using Machine Learning include productrecommendation, consumer purchase behavior prediction, prediction of energy usage for bettermaintenance, recommending financial trading, etc.

In the most recent quarter, did your workplace use Machine Learning? If so, in how many businessprocess(es) has your workplace used Machine Learning?

0 – No use

1 business process








Don’t know

10


12. For which business process(es) has your workplace use Machine Learning? (Check all that apply)

Recommendation engines / product recommendation

Consumer purchase behavior prediction

Medical services

Online customer support

Information retrieval

Database mining

Churn modeling

Dynamic pricing

Customer segmentation

Prediction of energy usage to optimize maintenance

Recommend financial trading

Fraud detection


11

Decreased

greatlyDecreased

slightlyThe

sameIncreased

slightlyIncreased

greatly

Notrelevantfor this

workplace

Managers




Production workers

13. How did the introduction of Machine Learning affect the number of workers at your workplace? Pleaserespond to changes that happened because of Machine Learning technology only.

12

Please consider the following report on AI adoption in businesses in answering the nextquestions.


A 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.

While the potential for AI is vast, most organizations still have a long way togo in developing the core practices that enable them to realize the potentialvalue of AI at scale. Business executives and managers will need to thinkabout how to incorporate AI into their business strategy, as well as thetransparency and “explainability” of AI algorithms, biases in data, andconcerns about safety and privacy.

For the next questions assume you are in the position to make artificialintelligence technology investments and human resource decisions foryour company.

13

B 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.

Until now, states and the federal government have enacted little oversightand regulation specific to AI. But a new Algorithmic Accountability Act isexpected to change that. Under this Act, firms that are using or selling AIrelated products are subject to a variety of requirements governing their useof AI systems. Requirements include disclosure of firm usage of AI systems,including their development process or contractor of origin, AI system design,model training, and data gathered and in use. The Act also requires firms todisclose to a government agency the impact of their AI systems on safety,accuracy, fairness, bias, discrimination, and privacy. The regulation isexpected to go into effect in 2020.


14

C 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.

As the development of AI-related products requires more data, policymakersand the public are increasingly concerned about data privacy. For example,California’s recently-enacted digital privacy initiative, the California ConsumerPrivacy Act of 2018 (CCPA), will affect all businesses buying, selling orotherwise trading the “personal information” of California residents–– including companies using online-generated data from residents acrosstheir products. In order to stay compliant with the regulation, firms mustdisclose how they use and store personal data, and how they conform withdata privacy rules. California’s regulation goes into effect in 2020. Otherstates are expected to enact similar data privacy regulations in the nearfuture.


15

D 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.

Although some observers believe little oversight and regulation has beenattached to the area of AI training and product deployment, firms using AItechnology in the United States generally are subject to common law andstatutory requirements. Existing law (e.g., tort law) may require that acompany avoid any negligent use of AI to make decisions or provideinformation that could result in harm to the public. Current employment, labor,and civil rights laws create the risk that a company using AI to make hiring ortermination decisions could face liability for its decisions involving humanresources. These legal requirements apply now, and will likely continueapplying to future products, services, and company practices.


16

E 20.0% Recent research has found that early adopters of AI have started to reap thebenefits of their investments in this technology. First-movers have alreadydeployed and marketed AI-related solutions across healthcare, autonomousdriving, retail and so on. Forty-seven percent of companies say they haveembedded at least one AI capability in their business processes.

The healthcare and drug sectors have been actively developing AItechnologies for various purposes including patient diagnosis, treatment,drug development, and patient monitoring and care. The Food and DrugAdministration (FDA) currently regulates the industry and has proposed anew regulatory framework for AI/Machine Learning-based software. Thisframework aims to examine and pre-approve the underlying performance ofthe firm’s AI products before they are marketed, and post-approve anyalgorithmic modifications. In this process, the FDA will assess the firm’sability to manage risks associated with various issues such as, transparencyand explainability (e.g., diagnosis recommendation algorithms), and security(e.g., use and protection of patient private information) of the AI/MachineLearning based software. FDA’s proposed framework is expected to go intoeffect in 2020.


17


14. To what extent would you adopt AI? Please respond in terms of the total number of businessprocesses in which you would adopt any AI technology. If your business is currently adopting AI pleaseinclude those processes in the total number.

0 – No adoption

1 business process










15. What is the biggest annual budget you have been responsible for in your career to date?

Less than $10,000

$10,000-$100,000

$100,000-$500,000

$500,000-$1,000,000

$1,000,000-$5,000,000

More than $5,000,000

18

16. Adopting AI technology could entail a variety of costs. For example, there could be costs related tohiring technical workers, purchasing AI packages, computers and data centers, purchasing or gatheringdata, research and development, developing AI strategies for your business, consulting fees, assessing theimpact of AI product and services.

How much would you budget for AI adoption at your company in the following year? Pleaseconsider all potential costs and write in the dollar amount in whole numbers.

AI-related research and development (e.g., R&D costs related to creating new AI products orprocesses)

Hiring the workforce to manage, operate, and maintain AI systems at your company (e.g.,managers, technicians, programmers, etc. but excluding R&D workers)

AI training for existing employees (e.g., coding, how to use AI technology, etc.)

Purchase of AI packages from external vendors (e.g., AI software, analysis fees, etc.)

Computing resources and data related costs for AI systems at your company (e.g., computers,cloud computing, data collection and purchase costs, etc.)

Developing AI strategy that is compatible with your company's overall business strategy (e.g.,consulting and marketing costs, internal strategy development, assess ethical impact, etc.)

17. What percentage of the above total AI budget would you allocate to each of the below 6 expensecategories? Please write down the percentages in integers without the % sign. The percentages shouldadd up to 100. Write down 0 for any category that you would not allocate any expenses to.

19


Decrease

greatlyDecrease

slightlyThe

sameIncreaseslightly

Increasegreatly

Notrelevantfor this

workplace

Co-operation on AI related R&D activities with other institutions(universities, research institutes, other businesses, etc.)

Filing of AI related patents

Introduction of an AI related good, service, or production/deliverymethod that is new or significantly improved

18. How would you adjust each of below AI related innovation activities at your workplace next year?

Not

importantSlightly

importantModeratelyimportant Important

Veryimportant

Layoffs or labor related issues due to AI adoption

Racial and gender bias/discrimination from AI algorithms

Safety and accidents related AI technologies

Privacy and data security issues related to AI adoption

Transparency and explainability of AI algorithms

19. AI-related technologies can introduce various ethical issues in businesses. How important would youconsider each of the following ethical issue when adopting AI at your business?

20

20. Who do you think is primarily responsible for minimizing AI-related ethical issues that could arise at yourbusiness?

Managers in my company

Engineers in my company

AI package vendors

The government, i.e., regulatory agencies

The court, i.e., the legal system


Decrease

greatlyDecrease

slightlyThe

sameIncreaseslightly

Increasegreatly

Notrelevantfor this

workplace

Managers


Office workers (e.g., HR, accounting, secretarial workers, etc. butnot in managerial positions)

Service workers (e.g., customer service, client service, careworkers etc.)

Sales workers

Production workers

21. What would you do to the below employees at your workplace in response to AI adoption nextyear? Please respond how you would adjust the number of each worker type because of AI adoptionat your workplace next year.

21

This is the last page. We would like to ask a little bit about the business you workfor.

Business characteristics


22. Which state is your workplace located in?

23. What is the primary way employees are promoted at this business?

Promotions were based solely on performance and ability

Promotions were based partly on performance and ability and partly on other factors (for example, tenure or family connections)

Promotions were based mainly on factors other than performance and ability (for example, tenure or family connections)

Employees are not normally promoted

24. In the past year, what typically happened to under-performing employees at your workplace?

Reassigned or dismissed within 6 months of identifying employee under-performance

Reassigned or dismissed after 6 months of identifying employee under-performance

Under-performing employees are not normally reassigned or dismissed

No under-performing employees were identified in the past year

25. How many employees does this business usually have? If the business has multiple establishments,please respond in regards to your current workplace

less than 50

50-249

250-499

500-999

1,000-4,999

5,000 or above

22

26. What is your company’s annual revenue?

Less than $100K

$100K to $499K

$500K to $999,999K

$1M to $4.9MM

$5MM to $9.9MM

$10MM to $49.9MM

$50MM to $99.9MM

$100MM to $499.9MM

$500MM to $999,999B

$1B or more

27. The final question is a request for feedback about the responses you provided so far. It is vital to ourstudy that we only include responses from people who devoted their full attention to this study.This will not affect in any way the payment you will receive for taking this survey.

In your honest opinion, should we use your responses, or should we discard your responses sinceyou did not devote your full attention to the questions so far?

Yes, I have devoted full attention to the questions so far and I think you should use my responses for your study.

No, I have not devoted full attention to the questions so far and I think you should not use my responses for your study.

23

This survey is being conducted by researchers at Stanford ...yongslee/AIReg_FDA.pdf · Consumer purchase behavior prediction Medical services Online customer support Information retrieval

Documents