1. Home
  2. misinformation

misinformation

AI researchers say they’ve found a way to jailbreak Bard and ChatGPT

Artificial intelligence researchers claim to have found an automated, easy way to construct "adversarial attacks" on large language models.

United States-based researchers have claimed to have found a way to consistently circumvent safety measures from artificial intelligence chatbots such as ChatGPT and Bard to generate harmful content. 

According to a report released on July 27 by researchers at Carnegie Mellon University and the Center for AI Safety in San Francisco, there’s a relatively easy method to get around safety measures used to stop chatbots from generating hate speech, disinformation, and toxic material.

The circumvention method involves appending long suffixes of characters to prompts fed into the chatbots such as ChatGPT, Claude, and Google Bard.

The researchers used an example of asking the chatbot for a tutorial on how to make a bomb, which it declined to provide. 

Screenshots of harmful content generation from AI models tested. Source: llm-attacks.org

Researchers noted that even though companies behind these LLMs, such as OpenAI and Google, could block specific suffixes, here is no known way of preventing all attacks of this kind.

The research also highlighted increasing concern that AI chatbots could flood the internet with dangerous content and misinformation.

Professor at Carnegie Mellon and an author of the report, Zico Kolter, said:

“There is no obvious solution. You can create as many of these attacks as you want in a short amount of time.”

The findings were presented to AI developers Anthropic, Google, and OpenAI for their responses earlier in the week.

OpenAI spokeswoman, Hannah Wong told the New York Times they appreciate the research and are “consistently working on making our models more robust against adversarial attacks.”

Professor at the University of Wisconsin-Madison specializing in AI security, Somesh Jha, commented if these types of vulnerabilities keep being discovered, “it could lead to government legislation designed to control these systems.”

Related: OpenAI launches official ChatGPT app for Android

The research underscores the risks that must be addressed before deploying chatbots in sensitive domains.

In May, Pittsburgh, Pennsylvania-based Carnegie Mellon University received $20 million in federal funding to create a brand new AI institute aimed at shaping public policy.

Magazine: AI Eye: AI travel booking hilariously bad, 3 weird uses for ChatGPT, crypto plugins

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins

Forget Cambridge Analytica — Here’s how AI could threaten elections

While disinformation is an ongoing issue that social media has only contributed to, AI could make it much easier for bad actors to spread disinformation.

In 2018, the world was shocked to learn that British political consulting firm Cambridge Analytica had harvested the personal data of at least 50 million Facebook users without their consent and used it to influence elections in the United States and abroad.

An undercover investigation by Channel 4 News resulted in footage of the firm’s then CEO, Alexander Nix, suggesting it had no issues with deliberately misleading the public to support its political clients, saying:

“It sounds a dreadful thing to say, but these are things that don’t necessarily need to be true. As long as they’re believed”

The scandal was a wake-up call about the dangers of both social media and big data, as well as how fragile democracy can be in the face of the rapid technological change being experienced globally.

Artificial intelligence

How does artificial intelligence (AI) fit into this picture? Could it also be used to influence elections and threaten the integrity of democracies worldwide?

According to Trish McCluskey, associate professor at Deakin University, and many others, the answer is an emphatic yes.

McCluskey told Cointelegraph that large language models such as OpenAI’s ChatGPT “can generate indistinguishable content from human-written text,” which can contribute to disinformation campaigns or the dissemination of fake news online.

Among other examples of how AI can potentially threaten democracies, McCluskey highlighted AI’s capacity to produce deep fakes, which can fabricate videos of public figures like presidential candidates and manipulate public opinion.

While it is still generally easy to tell when a video is a deepfake, the technology is advancing rapidly and will eventually become indistinguishable from reality.

For example, a deepfake video of former FTX CEO Sam Bankman-Fried that linked to a phishing website shows how lips can often be out of sync with the words, leaving viewers feeling that something is not quite right.

Gary Marcu, an AI entrepreneur and co-author of the book Rebooting AI: Building Artificial Intelligence We Can Trust, agreed with McCluskey’s assessment, telling Cointelegraph that in the short term, the single most significant risk posed by AI is:

“The threat of massive, automated, plausible misinformation overwhelming democracy.”

A 2021 peer-reviewed paper by researchers Noémi Bontridder and Yves Poullet titled “The role of artificial intelligence in disinformation” also highlighted AI systems’ ability to contribute to disinformation and suggested it does so in two ways:

“First, they [AI] can be leveraged by malicious stakeholders in order to manipulate individuals in a particularly effective manner and at a huge scale. Secondly, they directly amplify the spread of such content.”

Additionally, today’s AI systems are only as good as the data fed into them, which can sometimes result in biased responses that can influence the opinion of users.

How to mitigate the risks

While it is clear that AI has the potential to threaten democracy and elections around the world, it is worth mentioning that AI can also play a positive role in democracy and combat disinformation.

For example, McCluskey stated that AI could be “used to detect and flag disinformation, to facilitate fact-checking, to monitor election integrity,” as well as educate and engage citizens in democratic processes.

“The key,” McCluskey adds, “is to ensure that AI technologies are developed and used responsibly, with appropriate regulations and safeguards in place.”

An example of regulations that can help mitigate AI’s ability to produce and disseminate disinformation is the European Union’s Digital Services Act (DSA).

Related: OpenAI CEO to testify before Congress alongside ‘AI pause’ advocate and IBM exec

When the DSA comes into effect entirely, large online platforms like Twitter and Facebook will be required to meet a list of obligations that intend to minimize disinformation, among other things, or be subject to fines of up to 6% of their annual turnover.

The DSA also introduces increased transparency requirements for these online platforms, which require them to disclose how it recommends content to users — often done using AI algorithms — as well as how it moderate content.

Bontridder and Poullet noted that firms are increasingly using AI to moderate content, which they suggested may be “particularly problematic,” as AI has the potential to over-moderate and impinge on free speech.

The DSA only applies to operations in the European Union; McCluskey notes that as a global phenomenon, international cooperation would be necessary to regulate AI and combat disinformation.

Magazine: $3.4B of Bitcoin in a popcorn tin — The Silk Road hacker’s story

McCluskey suggested this could occur via “international agreements on AI ethics, standards for data privacy, or joint efforts to track and combat disinformation campaigns.”

Ultimately, McCluskey said that “combating the risk of AI contributing to disinformation will require a multifaceted approach,” involving “government regulation, self-regulation by tech companies, international cooperation, public education, technological solutions, media literacy and ongoing research.”

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins

Bitcoin Proponents Accuse the New York Times of Publishing One-Sided ‘Hit Piece’ on Bitcoin Mining

Bitcoin Proponents Accuse the New York Times of Publishing One-Sided ‘Hit Piece’ on Bitcoin MiningAfter the New York Times was accused of writing favorable pieces about disgraced FTX co-founder Sam Bankman-Fried and inviting him to speak at the news outlet’s Dealbook Summit, it is once again being criticized for publishing a “hit piece” about bitcoin mining. The article’s authors claim that bitcoin mining is harmful to the environment, while […]

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins

Makerdao Co-Founder Proposes $14 Million Fund to Combat Climate Change; Crypto Supporters Mock Idea

Makerdao Co-Founder Proposes  Million Fund to Combat Climate Change; Crypto Supporters Mock IdeaCryptocurrency advocates have been discussing a proposal by the founder of Makerdao, Rune Christensen, to fund a Scientific Sustainability Fund. An idea that aims to combat climate change and misinformation about energy solutions. Christensen is asking for 20,000 MKR tokens to move forward with the idea. The draft of the Maker Constitution was criticized on […]

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins

New FTX CEO Discusses Possibility of Rebooting Defunct Crypto Exchange in First Interview Since Taking Over

New FTX CEO Discusses Possibility of Rebooting Defunct Crypto Exchange in First Interview Since Taking OverFollowing recent disclosure that FTX debtors and bankruptcy administrators located $5.5 billion in liquid assets, the new FTX CEO John J. Ray III discussed the business in his first interview since taking over the exchange’s restructuring process. Ray detailed during the interview that he is open to the possibility of reviving the now-defunct digital currency […]

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins

Poland’s Consumer Protection Agency Opens Case Against Cryptocurrency Exchange

Poland’s Consumer Protection Agency Opens Case Against Cryptocurrency ExchangeThe body ensuring that consumer rights are respected in Poland has initiated proceedings against a crypto exchange falsely claiming to be Polish. The trading platform also misled customers that it was operating with the regulatory approval of the financial authorities in the country. Belize-based Exchange Risks Hefty Fine in Poland for Allegedly Deceiving Crypto Traders […]

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins

Leaked Documents Show Facebook and Twitter Working Closely With DHS, FBI to Police Disinformation: Report

Leaked Documents Show Facebook and Twitter Working Closely With DHS, FBI to Police Disinformation: ReportThe U.S. Department of Homeland Security (DHS) and the Federal Bureau of Investigation (FBI) are reportedly working closely with major social media platforms, like Facebook and Twitter, to police “disinformation.” Leaked documents further show their plans to expand censorship. Leaked Documents Reveal How Department of Homeland Security Plans to Police Disinformation Leaked documents and court […]

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins

JPMorgan Reportedly Terminates Relationship With Kanye West, Rap Star Says He’s Happy to Speak Openly About Being ‘Canceled by a Bank’

JPMorgan Reportedly Terminates Relationship With Kanye West, Rap Star Says He’s Happy to Speak Openly About Being ‘Canceled by a Bank’On October 12, the conservative influencer and political commentator, Candace Owens shared a letter on Twitter that shows JPMorgan allegedly closed Kanye West’s (also known as Ye) bank accounts. The hip-hop star and rapper has been accused of making antisemitic statements in recent times, and some of his tweets have been removed from Twitter. Political […]

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins

PayPal says policy to punish users for misinformation was ‘in error’

Despite the retraction, the crypto community said the policy is a perfect example of why decentralization and self-custody of funds are so important.

Online payment network PayPal has reneged on a controversial policy that could’ve seen users fined $2,500 for spreading “misinformation,” with the payment platform claiming the policy update was published “in error.”

The now retracted misinformation clause in PayPal’s Acceptable Use Policy (AUP) was set to take effect on Nov. 3, which would have expanded on its list of prohibited activities to include “the sending, posting, or publication of any messages, content, or materials” that "promotes misinformation."

PayPal has since told multiple outlets reporting on the clause that the updated AUP went out in error and included incorrect information, clarifying that it would not fine its users for spreading misinformation:

“PayPal is not fining people for misinformation and this language was never intended to be inserted in our policy [...] Our teams are working to correct our policy pages. We’re sorry for the confusion this has caused."

The controversy has spread like wildfire on Twitter among both crypto and non-crypto observers, with some continuing to comment on the issue even after the retraction. 

Lightspark CEO and former PayPal president David Marcus, called it “insanity” that "a private company now gets to decide to take your money if you say something they disagree with.”

Tesla CEO and former PayPal co-founder Elon Musk responded to Marcus’ tweet with “Agreed.”

Maple Finance co-founder Sid Powell said the case at hand provides a textbook example as to why it is essential to have custody over your own funds.

Founder and CEO of crypto consulting and education platform Eight Michaël van de Poppe kept his opinion short and sweet, calling it “The end of PayPal.”

Related: Business owners should get off PayPal and move to the blockchain

But not everyone considered PayPal’s now retracted clause to be dishonorable to its users.

Chief Strategy Officer Meltem Demirors of digital asset investment firm CoinShares said that in any event, companies have the right to choose who can use its services without explanation:

“And if you think crypto is immune you're either naive or willfully ignorant,” she said, adding:

“Currently, 31% of post-merge Ethereum blocks are OFAC-compliant, meaning they censor transactions associated with specific contracts and addresses on a state-sponsored list.”

While the implementation of a fine would’ve been a first for PayPal, the payment giant is no stranger to deplatforming users it isn’t politically aligned with, having cut ties with domain registrar Epik in Oct. 2020 who provided services to the Proud Boys and other conservative groups.

Similarly to the broader stock market, PayPal (PYPL) has plummeted 64.65% over the last 12 months according to Yahoo Finance.

The NASDAQ is due to re-open on Sept. 10 at 9:30 am Eastern Time, so it remains to be seen whether the clause and its subsequent retraction will impact PayPal’s share price.

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins

New Paypal Policy Lets Firm Fine Users $2,500 for Spreading ‘Misinformation,’ ToS Condemned and Called an ‘Abomination’

New Paypal Policy Lets Firm Fine Users ,500 for Spreading ‘Misinformation,’ ToS Condemned and Called an ‘Abomination’A new Paypal user policy that permits the company to fine users $2,500 for spreading “misinformation” has caused quite a stir on social media platforms. After November 3, anyone who posts or publishes information or content to “promote misinformation” will be subject to the penalty. Editor’s note: This article was updated to reflect that Paypal […]

Analyst Says Ethereum Rival Mirroring Memecoin That Just Printed New All-Time High, Updates Outlook on Altcoins