The impact of text-generating technologies on academic integrity: AI & AI

July 13, 2021

I’ve been a bit behind with my blogging recently, so I’m going to try and catch up by sharing some recent conference presentations. This one I presented in June with Mike Mindzak and Ryan Morrison at the annual conference of the Canadian Association for the Study of Educational Administration (CASEA) [online].

Eaton, Mindzak & Morrison - GPT-3 and academic integrity

First, let me tell you the story of how I got connect with these two. In the early fall of 2020, Mike Mindzak at Brock University in St. Catharine’s, Ontario (Canada) reached out to me via e-mail to introduce himself. A colleague we have in common had pointed him in the direction of my work on academic integrity. He connected the dots, that I was the person who’d left him a comment on a piece he’d written for University Affairs, entitled, “What happens when a machine can write as well as an academic? 

Mike let me know about some work he was doing with Ryan Morrison at George Brown College in Toronto related to artificial intelligence and algorithmic writing. He asked if I might be interested in collaborating with them. Naturally, I was interested, but also recognized that the field of artificial intelligence is outside of my area of expertise and the demands on time were preventing me from doing a deep dive into any new projects. I suggested that we continue to chat throughout the fall and winter, and look at a possible collaboration for 2021.

In the meantime, I invited the two of them to present at the Academic Integrity Urgent and Emerging Webinar Series I was putting together for the Taylor Institute of Teaching and Learning. They accepted the invitation.

I submitted the manuscript for my book, Plagiarism in Higher Education: Tackling Tough topics in Academic Integrity in the final days of May, 2020. In the final chapter of the book I take a future-focused perspective, offering ideas about what the emerging challenges to plagiarism and academic integrity would look like in the not-too-distant future. I cite Mike’s article and contend that the role that artificial intelligence and machine learning will play with regards to ethics in teaching and learning will become a topic that we, educators and educational leaders, will have to contend with.

In late September of 2020, the three of us started working on a proposal to present at the 2021 Canadian Association for the Study of Educational Administration (CASEA). Proposals are normally due in the fall, around October, and undergo a rigorous double-blind peer review process before presenters are notified about whether their presentations have been accepted to the conference.

The three of us stayed in touch during the fall and winter months, as we all observed that the open artificial intelligence technologies (OpenAI) were developing fast. OpenAI’s latest version of its Generative Pre-Training Transformer (GPT),  GPT-3 had been released in summer 2020. The technology uses machine learning to simulate human writing through text-generation. We kept an eye on news and developments about the GPT-3 technology, exchanging e-mails with links to new stories we’d seen. 

By the time Mike and Ryan presented their webinar, “Exploring the Impacts of Text Generating Technologies on Academic Integrity” at the Taylor Institute of Teaching and Learning  on April 9, 2021, our proposal to present at the CASEA conference had been accepted. I was excited to host them for this webinar to kick off this work. I knew the topic of artificial intelligence and machine learning truly fit the theme of the webinar series – urgent and emerging topics in academic integrity. They presented to a small but engaged crowd and as the webinar series convener and host, I watched carefully as questions poured in. As with other topics we had covered in the series, connecting the dots between the new topic and academic integrity was the key.

On June 1, 2021 we had our presentation for CASEA, a scholarly society dedicated to the study of educational administration. I’d been a member of the society since I was a PhD student, as my own supervisor had introduced me to the society and the work years before. My work has focused mainly on higher education, and many of the CASEA members focus on K-12 educational administration, so it hasn’t been a perfect fit for me, but close enough that I have stayed connected over the years. Here’s the abstract for our session:

Abstract

Paper presented at the Canadian Society for the Study of Education (CSSE) 2021 – Canadian Association for the Study of Educational Administration (CASEA) (June 1, 2021) The purpose of this paper is to provide a theoretical and conceptual discussion of the rapidly emerging field of artificial intelligence (AI) and algorithmic writing (AW). The continued development of new tools—most notably at this time, GPT-3—continues to push forward and against the boundaries between the writing of human and machine. As issues surrounding AI continue to be actively discussed by scientists, futurists and ethicists, educational leaders also find themselves front and centre of debates concerning, academic writing, academic integrity and educational ethics more broadly. Three points of focus provide the basis for this analysis. Firstly, we examine the impact of AW on student writing and academic integrity in schools. Secondly, we discuss similar issues in relation to publication and academic scholarship. Finally, taken together, we discuss the broader ethical dimensions and implications that AI and AW will, and are, quickly bringing into education and the field educational administration and leadership.

We had lots of questions and reactions in the Zoom chat, as the conference was held online this year. We have archived our slides publicly online, so anyone can access them. Here is the reference with the link:

Eaton, S. E., Mindzak, M., & Morrison, R. (2021, June 1). The impact of text-generating technologies on academic integrity: AI & AI. Paper presented at the Canadian Association for the Study of Educational Administration (CASEA), University of Alberta [online]. http://hdl.handle.net/1880/113569

We are excited to see where this work will take us next. I have a feeling that the ethics of technology is going to become inextricably intertwined with academic integrity. How that develops is yet to be determined.

_____

Share or Tweet this: The impact of text-generating technologies on academic integrity: AI & AI https://drsaraheaton.wordpress.com/2021/07/13/the-impact-of-text-generating-technologies-on-academic-integrity-ai-ai/

This blog has had over 2 million views thanks to readers like you. If you enjoyed this post, please “like” it or share it on social media. Thanks!

Sarah Elaine Eaton, PhD, is a faculty member in the Werklund School of Education, and the Educational Leader in Residence, Academic Integrity, University of Calgary, Canada.

Opinions are my own and do not represent those of the University of Calgary or anyone else.


Microsoft’s new “Rewrite” feature: A challenge to academic integrity?

April 20, 2020

Microsoft has just announced a new feature in Word: “Rewrite”. Microsoft shared details of the feature in this blog post last Friday.  The feature is designed to provide “sentence-level suggestions” to help users improve their writing. Microsoft reports that, “This feature is powered by cutting-edge, neural-network, machine learning models, which are trained on millions of sentences.” Zhang Li of Microsoft writes that the new feature:

Improves fluency: These suggestions aim to improve the flow of the wording, including mechanics like grammar and spelling.

Concise phrasing: The goal of these suggestions is to express an idea clearly, without extra words.
Paraphrased sentence: These suggestions offer synonyms for alternative wording.

Improves readability: The goal of these suggestions is to make the writing easier to read for people with different reading abilities. In general, suggestions will include shorter, simpler wording.”

Reading through the blog post comments, users are anticipating this will replace services such as Grammarly. People in the tech world are already calling it a “game changer”.

From an academic integrity perspective, it certainly could change the game. Drastically. Scholars such as Ann Rogerson and Grace McCarthy started publishing articles about the impact of paraphrasing software a few years ago. Their article “Using Internet based paraphrasing tools: Original work, patchwriting or facilitated plagiarism” prompts us to consider how paraphrasing software impacts our notion of writing, plagiarism and “originality”.

Microsoft reports that the new feature is currently only available in English and requires a subscription to Microsoft Office 365.

My prediction is that this new feature will change writing as much as spell check has, but in ways that are infinitely more complex. Spell check offers suggestions on individual words. Grammar check highlights possible grammar errors. A feature designed to re-write entire sentences has the potential to shift writing in significant new ways.

This may challenge our notions of “original writing” in ways we cannot yet predict. Educators and administrators will have to figure out how, if at all, this will impact our understanding of plagiarism, authorship and originality. Only time will if assisted and augmented writing will become the new normal.

_________________________________________

Share or Tweet this: Microsoft’s new “Rewrite” feature: A challenge to academic integrity? https://wp.me/pNAh3-2ss

This blog has had over 2 million views thanks to readers like you. If you enjoyed this post, please “like” it or share it on social media. Thanks!

Sarah Elaine Eaton is a faculty member in the Werklund School of Education, and the Educational Leader in Residence, Academic Integrity, University of Calgary, Canada. Opinions are my own and do not represent those of the University of Calgary.


Lessons learned from 2 Million blog views

June 5, 2018

8 years.

614 posts.

5126 followers

2,014,851 views.

According to the blog stats, I’ve recently topped two million all-time blog views, with over 1.2 million visitors (some of whom have viewed more than one post, obviously):

All time views - posts

Here are some things I’ve learned about blogging as a result of this experience:

Keep on blogging

I know so many people who have started blogs, only to abandon them because they got too busy, got frustrated when they didn’t get a massive following instantly or just got bored.

Here’s a high-level graph that shows a steady increase in blog views and visitors over the years:

Year-over-year.jpg

Of course, the stats for 2018 are lower because year isn’t half over yet. But if you look at 2010 through 2017, you can see that the number of individual views, as well as the number of visitors, has increased steadily over time.

The graph below breaks it down a bit more. It shows how many views my blog has had over the months and years since I started it in February, 2010. Darker colours represent more views.

All time views - Months and years.jpg

In 2018, my monthly average has been about 39.9 thousand views per month, from January through May. (Given that I’m writing this post in early June, 2018, the numbers for this month don’t look very impressive, but that block will be dark blue by the end of the month.)

The number of views has increased consistently over time. The average number of views per month in 2010 was under 1400. What I had as a monthly average number of views in my first year of blogging is now almost my daily average!

When I tell people that my blog now gets over 1000 views per day, they look at me in disbelief, but here are the stats:

Average per day.jpg

Again, the numbers for June 2018 look low because that’s a monthly total and we’re still at the beginning of the month and that number is the average for the entire month. That number will increase throughout the month.

Look at all the light grey in the first two years of my blog. The real increases started to show in year 3 (2012). If I had given up blogging, I would never have seen those increases. My lesson learned here is: Keep on blogging, even when you think no one is reading. More readers will stop by as your blog gets populated with content.

Your progress is relative

There are some superstar bloggers out there who get millions of views every week. Some bloggers make money from their blogs, and others even blog for a living. But that was never my intention. My goal with my blog has been consistent: to share and archive content, document my own professional and learning experiences and offer tips to students and educators. The number of views and visitors is relative to the industry you work in, your purpose for blogging and how much content you share.

Sometimes you don’t know the reason for the stats

My best day for blog views was April 7, 2014:

All time views - posts

What happened that day? Nothing special, as far as I can tell. I didn’t even post that day. It was a complete fluke. I have no idea why that day in 2014 was my all-time daily maximum for blog views.

My learning from this is to not get too hung up on trying to achieve every day. Progress happens over time. Blips and flukes happen, too. The important thing is to not give up and stick with it.

Try different things

I have tried all kinds of different things over the years. I’ve written features about educators who inspired me (like this post about Deaf educator, Brent Novodvorski, for example). In 2012, I did a weekly series where I posted my favourite resources of the week. I have also used my blog as a space to archive material that I wanted to share online with readers, like this APA Checklist for Term Papers.

I have tried all kinds of different things over the years. My learning from this is that experimenting helped me to figure out what works. It also helped me to figure out what kind of blogger I want to be.

Develop your blogging identity

I have worked as an educator since 1994. It’s no secret that I love teaching! I love interacting with students, whether they are in a classroom or online. While I may have been experimental with my posts at times, I’ve been consistent that my blog has always been focused on learning in one way or another. I don’t post recipes or tips to improve your health or fitness. I post about education. My followers have come to expect posts about learning, teaching, leadership or a related topic.

My learning from this is to develop an identity as a blogger. I have grown and developed as both an educator and a blogger since I started my blog. I engage in regular reflection about what I have learned and what I still want to learn. For me, my professional growth and my development as a blogger have gone hand-in-hand over the past eight years.

Followers come from different places

Apparently, my blog has over 5000 followers:

Followers.jpg

Some folks follow along on WordPress, others get an e-mail every time a post is published and still others follow along on social media. WordPress doesn’t give me much information about who these followers are, but all I can say is, “Thank you!” I appreciate that you have read, liked and commented (or even just lurked) over the years. It makes me feel that my blog with worthwhile to you. What better reward could there be?

Approach comments with caution

Regular followers will know that I shut down the comments section on my blog a few years ago. For a long time, I was really excited to get comments on my blog. But then, things took a dark turn once the blog started to really gain views. The nature of some of the comments sometimes became rude, aggressive or abusive.

I expect that anyone who has spent a lot of time blogging has encountered something similar. I understand there are different thoughts on how to approach this. Some people believe that there’s no such thing as bad publicity and the more flaming comments, the better. Me, not so much. Ultimately, I decided to shut down the comments function. I still really appreciate it when people hit the “Like” button at the end of a post, but I’m not sure I’ll ever re-open the comments again.

Your blog can be an incubator for ideas

One highlight about developing my identity as a blogger and as a professional is that in 2010, the first year of my blog I wrote a post called, “Are your students plagiarizing? Here’s how you find out”. I wrote a few other posts about plagiarism over the next year. Several years later, academic integrity has developed into a major research area for me. In 2017, I published my first peer-reviewed research article on plagiarism.

My learning from this is that your blog can be a place where your ideas germinate and incubate. I think those early posts in plagiarism in 2010 planted a seed that grew over the years.

People sometimes steal your content

I am sorry to say that some of my best content has been replicated on other people’s blogs or sites without attribution to me. Of course this makes me sad and angry. I sometimes wonder if that experience was part of the reason my interest in plagiarism as a research interest developed? Not sure.

I have learned the hard way that there are some people who feel entitled to lift whatever they want off the Internet and claim it as their own.

At one point, I was so upset this by this, I took a long hiatus from blogging. I almost abandoned my blog altogether. Instead, I learned a few tips and tricks. I’ll share these in a future post. (Wink, wink!)

My advice for bloggers

My key piece of advice for bloggers is: Stick with it. Your blog is an expression of you and your ideas over time. Share whatever you want. Some people will love it and others won’t. That’s OK.

If people leave you hurtful comments, turn off the comments. Your blog is about you and those who appreciate the effort you put into it. Experiment. Try different things. No blog is perfect, so don’t aim for perfection. Aim to be yourself and share whatever inspires you. Over time, I bet you’ll be surprised to see how you grow as a result.

Blog on, my friends!

______________________________________________________

Share or Tweet this: Lessons learned from 2 Million blog views https://wp.me/pNAh3-2iZ

This blog has had over 2 million views thanks to readers like you. If you enjoyed this post, please “like” it or share it on social media. Thanks!

Sarah Elaine Eaton is a faculty member in the Werklund School of Education, University of Calgary, Canada.

Opinions are my own and do not represent those of the Werklund School of Education or the University of Calgary.


What kind of sources to include in your literature review

February 27, 2018

Graduate students who are unfamiliar with what is expected of them in terms of higher-level research writing can easily get overwhelmed when it comes to their literature review. A literature review can form part of a larger project, such as a chapter in a thesis or dissertation, and it can also be a standalone project. Regardless of whether it is part of a project or a standalone work, we (your professors) expect certain kinds of sources.

We learned what kinds of sources to include in literature reviews when we were students, but we are not always so good at articulating what those expectations are. The result can be frustration for both students and professors. In this post, I have curated tips and information that I have been sharing with graduate students over the past several years.

These tips are intended to be a guideline, not a prescription. They are based on my experience and include a healthy dose of my own opinion. For example, I am adamant that students should avoid citing Wikipedia in their research writing. I am also unapologetically opposed to quotation websites where students have been known to cut and paste quotations from great thinkers such as Aristotle or Plato. In my view, quotations for research writing ought to come from original works (or in a pinch, a translation of an ancient text).

Your professors or research supervisors will have their own ideas about what kind of sources to include in your literature review, so be sure to consult with them. Here’s what I tell my students:

Most respected sources

Books, peer-reviewed scholarly or scientific journals from reputable publishers. Avoid predatory journals. At least 80% of the total number of sources in your literature review should be sources from this category.

Sources that are OK to use in moderation

Credible edited journals that may not be peer-reviewed, but are highly respected in a professional field; edited conference proceedings; papers from well-respected research institutes or think tanks. Usually, not more than 20% of your sources should come from this category.

Sources that should be used sparingly

Materials from highly reputable news agencies such as the BBC or the Washington Post or highly respected websites, such as the Mayo Clinic. It is not that these sources are not credible, but that you want your research literature review to be strongly focused on research materials. For that reason, I recommend that not more than 5% of sources come from this category.

Sources to avoid

I mentioned two of the big ones above: Wikipedia and online quotation sites. Also avoid predatory journals and any sites (including popular media) that is less reputable.

Here’s an infographic to help you make wise choices about what kind of material to include in your literature review.

Hierarchy of Sources for Educational Research (1)

If your topic has limited sources available in the research, find and analyze what you can, but avoid “padding” your literature review with non-scholarly sources.

When you are learning how to write a literature review, it can be tricky to figure out what kinds of sources to include. Remember, you want to focus on producing a review that is evidence-informed and research-based. The quantity of sources you consult may be important, but quality is definitely important.

Talk with your supervisor about their expectations and get guidance as you go along. The more you work with scholarly or scientific sources, the better you will get at writing literature reviews.

Here’s a longer essay I wrote on this topic if you are interested in reading more:

Eaton, S. E. (2018). Educational Research Literature Reviews: Understanding the Hierarchy of Sources. Calgary: University of Calgary. Retrieved from http://hdl.handle.net/1880/106406

Related posts:

How many sources do you need in a literature review?  http://wp.me/pNAh3-1Hu

5 Websites to avoid referencing in your research papers  http://wp.me/pNAh3-1IA

What’s the difference between a manuscript and an article? http://wp.me/pNAh3-1SV

How to provide peer review feedback http://wp.me/pNAh3-1qH

Template for a 10-page graduate research paper in social sciences http://wp.me/pNAh3-1s2

How to narrow down your research topic http://wp.me/pNAh3-1Xf

Dear students, It is not O.K. to cite Wikipedia as a source for scholarly articles. Sincerely, your prof. http://wp.me/pNAh3-1qx

______________________________________________________

Share or Tweet this: What kind of sources to include in your literature review

This blog has had over 1.8 million views thanks to readers like you. If you enjoyed this post, please “like” it or share it on social media. Thanks!

Sarah Elaine Eaton is a faculty member in the Werklund School of Education, University of Calgary, Canada.

Opinions are my own and do not represent those of the Werklund School of Education or the University of Calgary.


Understanding Language Register

January 2, 2018

A few years ago I wrote a post on language register. It has become one of the most popular and often viewed posts on my blog. It is a long and fairly involved post, so for those who like their information in bite-sized pieces, here is a quick synopsis for you in the form of an infographic:

Language ReGISTER

It is important to understand the differences between registers so you can use language that is appropriate for a particular situation. If your register is too high, you may come across as being snobby, pretentious or arrogant. If your register is too low, you can come across as being inappropriately informal or too friendly.

It is not only English language learners who need to understand the difference between registers, but native speakers do too. One of the things I have observed in my work as a professor is that students sometimes write in a register that is too casual. Sometimes students do this because they do not want to come across as “stuffy” or pretentious. But casual writing in academic and professional papers can backfire. Writing that is overly casual is often not considered professional or terribly credible by the reader. It is important for students, professionals, scientists and academics to know the formal register for writing papers, theses and reports.

Here’s a free .pdf of this infographic that you can use for your own research or teaching purposes: Language Register (.pdf).

Check out these related posts:

Teaching formal and informal language register to native speakers of English http://wp.me/pNAh3-jV

Language Register and Why It Matters (Or: Why You Can’t Write An Academic Paper in Gangsta Slang) http://wp.me/pNAh3-1pr

______________________________________________________

Share or Tweet this: Understanding Language Register https://wp.me/pNAh3-25U

This blog has had over 1.8 million views thanks to readers like you. If you enjoyed this post, please “like” it or share it on social media. Thanks!

Sarah Elaine Eaton is a faculty member in the Werklund School of Education, University of Calgary, Canada.


%d bloggers like this: