For those who aren’t aware, Microsoft have decided to bake essentially an infostealer into base Windows OS and enable by default.
From the Microsoft FAQ: “Note that Recall does not perform content moderation. It will not hide information such as passwords or financial account numbers."
Info is stored locally - but rather than something like Redline stealing your local browser password vault, now they can just steal the last 3 months of everything you’ve typed and viewed in one database.
Teryl's Tales of Whim~ hat dies geteilt.
NosirrahSec 🏴☠️
Als Antwort auf Kevin Beaumont • • •Matt Hardy
Als Antwort auf NosirrahSec 🏴☠️ • • •Jon Greig
Als Antwort auf Kevin Beaumont • • •Fi 🏳️⚧️
Als Antwort auf Jon Greig • • •@jgreig
@hacks4pancakes
Speaking from my compliance aspect, this comprehensively fails PCI and GDPR immediately and the SOC2 controls list ain't looking so good either.
Elan Hasson
Als Antwort auf Fi 🏳️⚧️ • • •@munin @jgreig @hacks4pancakes
question, how does GDPR come into play if the data stays on your machine? Is it not just your data and "you" collecting it?
Fi 🏳️⚧️
Als Antwort auf Elan Hasson • • •@elan @jgreig @hacks4pancakes
Here: ico.org.uk/for-organisations/u…
Principle (e): Storage limitation
ico.org.ukElan Hasson
Als Antwort auf Fi 🏳️⚧️ • • •@munin @jgreig @hacks4pancakes
Yes i get that. I think that applies to when data is in the possession of someone else.
Is the data recall is collecting only kept locally?
Does this mean the data is yours since it's stored locally and doesn't leave your computer?
Perhaps the question is: does GDPR apply to data that remains in the possession of the individual whose information is being retained?
Fi 🏳️⚧️
Als Antwort auf Elan Hasson • • •@elan @jgreig @hacks4pancakes
Oh - no, you're focusing on a different part.
My citation of GDPR violation is: your data appears on a GDPR-enforced entity's screen during entry. Let's say, you check into a hotel and they need your billing address; this is part of the requisite collections for the workload being processed - the hotel needs to know your billing address in order to manage billing you.
Windows screen-scrapes this billing address.
The hotel is -still on the hook- for windows scraping this info, and has to be able to attest, when you demand its deletion later, that they extracted every instance of this information - and further, that this information did not percolate to -someone else-, like, for instance, Microsoft, for whom that information is -not- requisite for the processing of the workload in question.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •I've written up my thoughts on the Copilot Recall feature in Microsoft Copilot+ PCs
I think it will enable fraud and endanger users, and is not the sign of a company who are committed to security first.
doublepulsar.com/how-the-new-m…
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Microsoft Copilot+ Recall feature 'privacy nightmare'
Imran Rahman-Jones (BBC News)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Copilot+ Recall has been enabled by default globally in Microsoft Intune managed users, for businesses.
You need to enable DisableAIDataAnalysis to switch it off. learn.microsoft.com/en-us/wind…
Manage Recall for Windows clients - Windows Client Management
learn.microsoft.comKevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Two quick updates -
A) if you disallow recording of a website in Control Panel or GPO, in Chrome it is still recorded - disallow recording only works in Edge browser
B) Firefox and Tor Browser is recorded always, including in private mode - the exception is Hollywood DRM’d videos
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •I got ahold of the Copilot+ software.
Recall uses a bunch of services themed CAP - Core AI Platform. Enabled by default.
It spits constant screenshots (the product brands then “snapshots”, but they’re hooked screenshots) into the current user’s AppData as part of image storage.
The NPU processes them and extracts text, into a database file.
The database is SQLite, and you can access it as the user including programmatically. It 100% does not need physical access and can be stolen.
teilten dies erneut
Alexander Kknli, Jan Walzer und undead enby of the apocalypse haben dies geteilt.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •And if you didn’t believe me.. found this on TikTok.
There’s an MSFT employee in the background saying “I don’t know if the team is going to be very happy…”
They should probably be transparent about it, rather than telling BBC News you’d need to be physically at the PC to hack it (not true). Just a thought.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Code Of Ethics
sqlite.orgKevin Beaumont
Als Antwort auf Kevin Beaumont • • •So the code underpinning Copilot+ Recall includes a whole bunch of Azure AI backend code, which has ended up in the Windows OS. It also has a ton of API hooks for user activity monitoring.
Apps themselves can also search and make themselves more searchable.
It opens a lot of attack surface.
The semantic search element is fun.
They really went all in with this and it will have profound negative implications for the safety of people who use Microsoft Windows.
Hannah hat dies geteilt.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •If you want to know where tech companies are with AI safety, know Microsoft Recall won’t record screenshots of DRM’d movies..
..but will record screenshots of your financial records and WhatsApp messages, as corporate interests were prioritised over user safety.
And it’s enabled by default.
teilten dies erneut
Charlie Stross hat dies geteilt.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Copilot+ Recall feature pop quiz:
You deal with a sensitive matter on my Windows PC. E.g. an email you delete. Does Copilot Recall still store the deleted email?
Answer: yes. There's no feature to delete screenshots of things you delete while using your PC. You would have to remember to go and purge screenshots that Recall makes every few seconds.
If you or a friend use disappearing messages in WhatsApp, Signal etc, it is recorded regardless.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •It comes up a lot as people are rightly confused, but if you wonder what problem Microsoft are trying to solve with Recall:
It isn't them being evil, it's business leaders who are middle aged and can't remember what they're doing driving decision making about which problems to solve.
A huge amount of business leaders are dudes who have no idea what the fuck is happening. This leads to the Recall feature.
Microsoft exists in and is driven by that bubble.
teilten dies erneut
tante hat dies geteilt.
Dave
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Dave • • •Misuse Case
Als Antwort auf Kevin Beaumont • • •@Laird_Dave So this is definitely geared towards not just middle-aged dudes but managers.
Like, can these people not just organize their emails into folders by topic? Microsoft could have re-worked the Outlook rules function to make this easier instead of whatever this is.
Dave
Als Antwort auf Misuse Case • • •@MisuseCase yeah, that would probably help a lot more while being a lot less creepy (and liability risk)
In turn, the liability risk will be the nicest "feature" of this shit. I'll drive a wooden stake through Recalls heart for my org before it has a chance to lay eggs.
Misuse Case
Als Antwort auf Dave • • •Kevin Beaumont
Als Antwort auf Misuse Case • • •Misuse Case
Als Antwort auf Kevin Beaumont • • •@Laird_Dave Sure, I can see that. But Microsoft has a lot of enterprise customers with CISOs, legal departments, regulatory requirements, etc. for whom Recall is worse than useless. That actually describes most of their largest enterprise customers!
Do they even pay attention to their own customers at all?
Sure enterprises can use GPO to turn it off but why make something that most of your biggest customers are going to have to turn off?
Kevin Beaumont
Als Antwort auf Misuse Case • • •@MisuseCase @Laird_Dave you could say that with a lot of things they've built lately, e.g. Copilot in Edge, Office etc (as it's just mass copyright theft).. but... uh... a lot of enterprises won't turn it off (and instead will pay for it).
I barely saw customers mentioned while working at Microsoft, in fact I remember meetings where people laughed at how stupid the customers are (e.g. the MS Exchange ones around ProxyLogon). Enterprise customers are just cows to milk for shareholders.
Martin Schröder
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Some screenshots of Recall's SQLite database here: mastodon.social/@detective/112…
Just to clarify, I can access it without SYSTEM too. Microsoft are about to set cybersecurity back a decade by empowering cyber criminals via poor AI safety. Feature ships in a few weeks.
Albacore
2024-05-27 14:30:16
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •The latest Risky Business episode on Recall is good, but one small correction - it doesn’t need SYSTEM rights.
Here’s a video of two MSFT employees gaining access to the Recall database folder - with SQLite database right there. Watch their hacking skills. (You don’t need to go this length as an attacker, either). Cc @riskybusiness
I’m not being hyperbolic when I say this is the dumbest cybersecurity move in a decade. Good luck to my parents safely using their PC.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Stealing everything you’ve ever typed or viewed on your own Windows PC is now possible with two lines of code — inside the Copilot+ Recall disaster.
My look at the feature, FAQs from the community etc
doublepulsar.com/recall-steali…
teilten dies erneut
Bianca Kastl hat dies geteilt.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •this is the out of box experience for Windows 11's new Recall feature on Copilot+ PCs. It's enabled by default during setup and you can't disable it directly here. There is an option to tick "open Settings after setup completes so I can manage my Recall preferences" instead.
HT @tomwarren
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •You allow BYOD so people can pick up webmail and such. It’s okay, because when they leave you revoke their access, and your MDM removes all business data from the machine ✅
What the employee does: opens Recall, searches their email, files etc and pastes the data elsewhere.
Nothing is removed from Recall, as it is a photographic memory of everything the former employee did.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Security and privacy researchers - You can now install Copilot+ Recall on any ARM hardware (doesn’t need an NPU) or in Azure VMs.
Guide from @detective
The devices launch THIS MONTH to customers so I suggest people look at this.
github.com/thebookisclosed/Amp…
GitHub - thebookisclosed/AmperageKit: One stop shop for enabling Recall in Windows 11 version 24H2 on unsupported devices
GitHubKevin Beaumont
Als Antwort auf Kevin Beaumont • • •Nvidia and AMD are bringing Microsoft’s Copilot Plus AI features to gaming laptops
Tom Warren (The Verge)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Recent DHS published report handed to the US President which said it had "identified a series of Microsoft operational and strategic decisions that collectively pointed to a corporate culture that deprioritized enterprise security investments and rigorous risk management"
Microsoft: let’s use AI to screenshot everything users do every 5 seconds, OCR the screenshots, make it searchable and store it in AppData!
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •If anybody is wondering if you can enable Recall on a machine remotely without Copilot+ hardware support - yep.
I’ve also found a way to disable the tray icon.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •I went and looked at YouTube for Recall to get out of the echo chamber and I can only find one positive video. Even the people at the event are slating it, including people with media provided Copilot+ PCs.
There’s some content creators who’ve realised it records their credit cards, so they’re making videos of their cards going walkies.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •It’s going to be interesting to see how Microsoft get out of this one. They may have contractual commitments to ship Recall with external parties.
I thought they were risking crashing the Copilot brand with this one, but I was wrong looking at the videos and comments on them - I think they’re crashing the Windows consumer brand.
The reaction to photographic memory of what people do at home has - you’ll be surprised to know - not been seen as a reason to buy a device, but a reason why not to.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •"Microsoft should recall Windows Recall" — Security researcher discovers Microsoft's new AI tool is woefully insecure
Zac Bowden (Windows Central)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Microsoft has been declining to comment on criticism of Recall for a week - but they have apparently told a journalist off the record at Future that changes will be made before Copilot+ devices drop in the coming days.
This may include an attempt to invalidate researcher criticism, we’ll see.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •WIRED has a piece about Total Recall, a now released tool which dumps keypresses, text and screenshots (they’re JPEGs) from Microsoft Recall
wired.com/story/total-recall-w…
Total Recall software by @xaitax github.com/xaitax/TotalRecall
Example search for ‘password’:
🪟 Captured Windows: 133
📸 Images Taken: 36
🔍 Search results for 'password': 22
📄 Summary of the extraction is available in the file:
C:\Users\alex\Downloads\TotalRecall\2024-06-04-13-49_Recall_Extraction\TotalRecall.txt
GitHub - xaitax/TotalRecall: This tool extracts and displays data from the Recall feature in Windows 11, providing an easy way to access information about your PC's activity snapshots.
GitHubKevin Beaumont
Als Antwort auf Kevin Beaumont • • •I hadn’t been aware until today of the external reaction to Recall. Holy shit. Tim Apple must be pleased.
Everything from media coverage to YouTube to TikTok is largely negative. All the comments are negative.
These videos have tens of millions of views and hundreds of thousands of comments.
I knew it would be bad but.. it’s worse. I’ve spent hours looking at the sentiment and.. well, they probably would have got better coverage from launching an NFT of pregnant Clippy.
Killa Koala
Als Antwort auf Kevin Beaumont • • •Charlie Stross
Als Antwort auf Killa Koala • • •Rebecca Cotton-Weinhold
Als Antwort auf Killa Koala • • •Charlie Stross
Als Antwort auf Rebecca Cotton-Weinhold • • •Rebecca Cotton-Weinhold
Als Antwort auf Charlie Stross • • •smallgreencloud
Als Antwort auf Charlie Stross • • •Charlie Stross
Als Antwort auf smallgreencloud • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •A key element of Recall is Microsoft say only you can access your Recall, it is per user.
ArsTechnica enabled Recall on Windows 11 box and tested the claim. By logging in as another user they could access the database and screenshots.
arstechnica.com/ai/2024/06/win…
Windows Recall demands an extraordinary level of trust that Microsoft hasn’t earned
Ars TechnicaKevin Beaumont
Als Antwort auf Kevin Beaumont • • •If you want to know how Microsoft have got themselves into this giant mess with Recall, here’s what the documentation says between the lines:
you, the customer, are a simpleton who doesn’t want to be an AI genius yet. Have a caveman mode.
Lars Marowsky-Brée 😷
Als Antwort auf Kevin Beaumont • • •The "This is not, ever, a good use case for it" is completely beyond their mental capabilities to grasp as an idea.
Barry Schwartz 🫖
Als Antwort auf Lars Marowsky-Brée 😷 • • •It was vaguely like this with naïve pattern matchers, a while back. That's how come FreeDesktop has a forever-broken and completely unfixable way of selecting fonts.
It is entirely incapable of following the correct rules specified by OpenType. It uses a naïve pattern matcher instead of following the clear specification.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Recall and Copilot+ is also coming to ASUS systems, including AMD, in a deal with Microsoft.
ASUS Announces Complete Portfolio of AI-Powered Copilot+ PCs asus.com/us/news/pnm9tg6qccql6…
Nvidia announced they are bringing Copilot+ and Recall to PCs, in a deal with Microsoft: theverge.com/2024/6/2/24169568…
Nvidia and AMD are bringing Microsoft’s Copilot Plus AI features to gaming laptops
Tom Warren (The Verge)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Three Copilot+ Recall questions that keep coming up.
Q. Can you alter the Recall history?
A. Yes. You can change the OCR database and change the screenshots as the logged in user or as software running as the local user. There is no audit log of changes.
Q. Are they snapshots, as Microsoft says, or screenshots?
A. They are just screenshots, jpegs.
Q. What is to stop apps on your machine accessing your Recall covertly?
A. Nothing. There is no audit log of access.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •If anybody is wondering what Microsoft's reaction to any of the Copilot+ Recall concerns are, they're continuing to decline comment to every media outlet.
I've seen comments MS staff have been given for enterprise customers, which are nonsense handwaving.
Product ships live on devices from Dell, Lenovo etc this month. x.com/zacbowden/status/1798221…
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •James Forshaw :donor: (@tiraniddo@infosec.exchange)
Infosec ExchangeKevin Beaumont
Als Antwort auf Kevin Beaumont • • •GitHub - xaitax/TotalRecall: This tool extracts and displays data from the Recall feature in Windows 11, providing an easy way to access information about your PC's activity snapshots.
GitHubKevin Beaumont
Als Antwort auf Kevin Beaumont • • •You can now remotely dump Recall data and screenshots over the internet from Linux etc. Changes in flight for parsing data too.
github.com/Pennyw0rth/NetExec/…
Add Recall module for dumping all users Microsoft Recall DBs & screenshots by Marshall-Hallenbeck · Pull Request #335 · Pennyw0rth/NetExec
GitHubKevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Turns out speaking out works.
Microsoft are making significant changes to Recall, including making it specifically opt in, requiring Windows Hello face scanning to activate and use it, and actually encrypting the database.
There are obviously going to be devils in the details - potentially big ones.
Microsoft needs to commit to not trying to sneak users to enable it in the future, and it needs turning off by default in Group Policy and Intune for enterprise orgs.
theverge.com/2024/6/7/24173499…
Windows won’t take screenshots of everything you do after all — unless you opt in
Tom Warren (The Verge)teilten dies erneut
sprouting Ske-lil-ton 🌱, Ralf Bendrath und June T. Michael haben dies geteilt.
Lulu · לולו
Als Antwort auf Kevin Beaumont • • •June T. Michael
Als Antwort auf Kevin Beaumont • • •Aber da ich die ganze Sache mitverfolge und regelmäßig dazu was teile, teile ich der Vollständigkeit halber auch diese Neuigkeiten. Microsoft rudert zumindest teilweise zurück, weil genug Leute geschimpft haben
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Obviously, I recommend you do not enable Recall, and you tell your family not to enable it too.
It’s still labelled Preview, and I’ll believe it is encrypted when I see it.
There are obviously serious governance and security failures at Microsoft around how this played out that need to be investigated, and suggests they are not serious about AI safety.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Microsoft reverses course, makes Recall feature opt-in only after security backlash
therecord.mediaKevin Beaumont
Als Antwort auf Kevin Beaumont • • •I should be transparent btw that I took Satya and Charlie’s commitment to security at face value too - I even published a blog on it backing that up - and I have concerns (it isn’t just me).
They’re now going to have to win trust back about winning trust back.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •I know somebody at a retailer in Europe that is selling Copilot+ PCs. They’ve had fewer than a thousand preorders through to customers.
In relative terms, for them it’s about as successful as Suicide Squad Kill The Justice League.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •A reminder that a few weeks ago at RSA, Microsoft signed CISA's Secure By Design pledge... and then shipped an enabled by design keylogger that OCRs your screen constantly into AppData.
Edit: I should say that's less a reflection on Microsoft and more a reflection on CISA's Secure By Design pledge.. it's a good idea, but the scope is extremely limited.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •I think MS are a way off extracting themselves from Recall situation they've got themselves into.
This is just one YouTube comments section on a video since the not-enabled-by-default change - 500k views - but there's loads more, similar on TikTok.
I imagine it's going to continue through week and into next week when the laptops ship.
I have heard rumblings MS are discussing trying to take action against me over the whole thing, which a) good luck and b) would be pouring petrol on the flames.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Some backstory - it's being reported Microsoft developed Recall in secret to try to avoid scrutiny. windowscentral.com/software-ap…
I'm hearing that various MSFT people are furious about how this played out over the past few weeks, which IMHO represents a serious lack of introspection.
A PR disaster: Microsoft has lost trust with its users, and Windows Recall is the straw that broke the camel's back
Zac Bowden (Windows Central)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Microsoft have paused the rollout of Windows 11 24H2 in preview channel, it was the version containing Recall. Microsoft have not explained why.
x.com/brandonleblanc/status/17…
I don't know if it was publicly known but it was possible to use Recall on more hardware via Mach2, before this was pulled.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •To put this one into perspective, there's one broadcast TV network looking at Recall still, and an investigative journalist.
Plus I imagine @evacide, @wdormann etc would have something to say if MS tried holding anybody but themselves accountable for their own actions.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •I have an image where when viewed on a Copilot+ Recall PC, a Windows process crashes as it tries to process the screenshot.
New email signature?
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Microsoft’s President Brad Smith appears before US House Committee on Homeland Security tomorrow.
His testimony: homeland.house.gov/wp-content/…
In this bit he talks about Recall (not named), where he pats himself and Microsoft on the back for “a feature change” and job well done.
Given it has been a complete cybersecurity and privacy car crash - and as of today the changes (plural) they’re referring to haven’t even been implemented - it seems like Microsoft fails to grasp customer needs: safety.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •One other thing - Microsoft's written testimony to the US House says, quoting, bolded by MS:
"Before I say anything else, I think it’s especially important for me to say that Microsoft accepts responsibility for each and every one of the issues cited in the CSRB’s report. Without equivocation or hesitation. And without any sense of defensiveness."
Counterpoint: they publicly disputed the report in the media. theverge.com/2024/4/25/2413991…
Microsoft needs to win back trust
Tom Warren (The Verge)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •I should say that if Brad is asked about Recall tomorrow, the answers may raise some.. uh... eyebrows here.
I don't know what MS SLT have been told, but expect fun when the feature drops on consumer laptops in a few days.
As I mentioned in my blog, there is some more security hardening there on Copilot+ PCs (this was before MS put out their blog)... but it's still easily bypassable.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Microsoft’s Recall puts the Biden administration’s cyber credibility on the line
cyberscoop.com/microsoft-recal…
Interesting article. All through this, CISA and the DHS have declined to comment.
Microsoft’s Recall puts the Biden administration’s cyber credibility on the line
eliasgroll (CyberScoop)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •The Verge reports today that "Windows engineers are scrambling to get additional changes tested and ready for the release of Copilot+ PCs next week."
It also says "Recall was developed in secret at Microsoft, and it wasn’t even tested publicly with Windows Insiders."
I've also been told Microsoft security and privacy staff weren't provided Recall, as the feature wasn't made available broadly internally either.
theverge.com/2024/6/13/2417770…
Xbox delivered and Windows scrambles to secure Recall
Tom Warren (The Verge)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Brad Smith just said Recall was designed to be disabled by default. That is not true. Microsoft’s own documentation said it would be enabled by default - they only backtracked after outcry.
He has somehow got almost every detail about Recall wrong while testifying.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Obviously, I’ll wait to see the announcement but it sounds like they’ve finally realised they need to take the time and get the feature right (and frankly consider the target audience - most home users, it ain’t).
They should have announced this before or during the US House hearing.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Announcement is out. Good on Microsoft for finally reaching a sane conclusion.
- Recall won’t ship as a feature at launch on Copilot+ PCs any more.
- Won’t be available in Insider preview channel at launch, as it was pulled.
When it does appear in preview channels, privacy and security researchers need to keep a close eye on what Microsoft are doing with the feature.
Microsoft tried developing this feature in secret in a way which tried to avoid scrutiny. Thank you to everyone who stood up.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •If anybody is wondering, Microsoft moved the announcement up as I scooped them 🤣
Thank you to everyone who helped out with this one, there was no way something that constantly OCR’d the screen being implemented so poorly was acceptable but Microsoft really, really dug their heels in.
Photographic memory of everything you’ve ever done on a computer has to be entirely optional, with risks explained and be done right.. or not at all. Accountability matters.
Microsoft, be better.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •If anybody wonders if Recall classifies what porn you watch, yes. Aside from OCRing text it also classifies images in videos.
9 minute 50 second mark in this, screen is blurred for obvious reasons.
youtu.be/2GTI00pFcLc?si=EiBEaJ…
Wir haben Windows Recall ausprobiert, damit ihr es nicht müsst
YouTubeKevin Beaumont
Als Antwort auf Kevin Beaumont • • •Here’s the clip translated around adult content with Microsoft Recall.
They filter search terms in English like nude - but don’t filter it in other languages.
Everything you view - including in videos - is classified and stored in the database regardless.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •This is pretty good - detecting Microsoft Recall misuse for data exfil. youtu.be/SV9-dn-5uEY?si=jVz9sC…
I tested this against the latest release of Recall and both TotalRecall and these detections still work.
Obviously Recall may well alter before it hits Insider preview channel, nobody needs to rush out detections yet.
Btw all through this saga, Microsoft Defender never triggered Recall specific alerts for me. Sophos did.
Microsoft Recall: Detecting Abuse | Threat SnapShot
YouTubeKevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Windows 11 24H2 preview release has been rereleased (but only for Copilot+ devices). It doesn’t include Recall any more.
pcworld.com/article/2370043/wi…
Additionally the Copilot+ PCs now have an update which enables the other AI features. This wasn’t available until a few hours ago, hence the lack of unsupervised reviews of the devices. It means you will see those reviews drop after the devices launch tomorrow.
Windows 11's latest update is kind of insane, in a bad way
Mark Hachman (PCWorld)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •There’s a website which gives some insight into how the UI and marketing push for Copilot+ Recall came together. The actual video appears to have gone MIA.
iamp.at/work/introducing-recal…
Introducing Recall - Patrick Flaherty
Patrick FlahertyKevin Beaumont
Als Antwort auf Kevin Beaumont • • •.@JohnHammond’s video on Recall is great, and a lot of fun - should also stop history being rewritten on this one later.
youtu.be/JujkOmvbgGw
Windows Recall (was) a Security Nightmare
YouTubeKevin Beaumont
Als Antwort auf Kevin Beaumont • • •I got ahold of what I think is the latest Microsoft Recall (Copilot+ Recall? Nobody knows the branding) build and.. well.. Total Recall still works with the smallest of tweaks to export the database, it's still accessible as a plaintext database with marketing as the security layer.
Another observation, the Recall backlog must be very large as it's just becoming a truck load of features being dumped on.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •One thing MS needs to fix in Recall, before the Insider canary build hits again, is the MSRC bug bounty.
As far as I can see, if you find a critical or high in Recall it qualifies for *drumroll* $1k bounty, unless I'm misinformed.
That probably needs clarifying as nobody is going to sell photographic memory access to Windows devices to MS for that value - it's way more valuable elsewhere.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •The Truth about Snapdragon X Laptops…
YouTubeKevin Beaumont
Als Antwort auf Kevin Beaumont • • •New Microsoft ads tout unavailable Recall feature, don't mention it was indefinitely delayed due to privacy concerns
Dallin Grimm (Tom's Hardware)sebastian büttrich
Als Antwort auf Kevin Beaumont • • •While that might be a nice partial interim success, #MicroSoft
will certainly not stop sneaking on users - it s their business concept, and you dont need graphical snapshots to track a user. There s telemetry you cant turn off. Try run a #Windows PC without net connection (or blocking connections to the overlords), and you will know.
There is one way to turn it off: install Linux.
#Total #Recall
Antonio Páez 🇲🇽🇨🇦
Als Antwort auf Kevin Beaumont • • •@WizardBear
Tech journalism is stenography
@cstross
Charlie Stross
Als Antwort auf Antonio Páez 🇲🇽🇨🇦 • • •Andrew
Als Antwort auf Kevin Beaumont • • •yikes yikes yikes fucking yikes.
I'm done with Microsoft. This is insanity. Windows is not going on any of my PCs ever again. I'd sooner buy a Mac, and I hate macOS.
Can Acar
Als Antwort auf Kevin Beaumont • • •so, ... your image analysis technology and your NPU HW are now so efficient that you don't even notice the power impact of doing this continuously in the background, and this is the only use case you could come up with?
Which means, I suppose, this is something they always wanted to do but was prevented because sending those images to the cloud for processing is clearly much worse.
Perhaps, when their privacy/security teams told them that it was a bad idea to process user screenshot images in the cloud, designers of these features assumed it would be OK to do it locally. And when they overcame this largest objection, other concerns must have seemed ... fine, in comparison.
Security/privacy teams are rarely in a position to kill off entire features, so this was most likely some kind of a compromise.
On a related note, a lesson I had to learn the hard way is to not push hard on the biggest security/privacy issue to the exclusion of others. If/when it somehow gets resolved, you look like you are trying to make excuses when you bring up the remaining concerns "
... mehr anzeigenso, ... your image analysis technology and your NPU HW are now so efficient that you don't even notice the power impact of doing this continuously in the background, and this is the only use case you could come up with?
Which means, I suppose, this is something they always wanted to do but was prevented because sending those images to the cloud for processing is clearly much worse.
Perhaps, when their privacy/security teams told them that it was a bad idea to process user screenshot images in the cloud, designers of these features assumed it would be OK to do it locally. And when they overcame this largest objection, other concerns must have seemed ... fine, in comparison.
Security/privacy teams are rarely in a position to kill off entire features, so this was most likely some kind of a compromise.
On a related note, a lesson I had to learn the hard way is to not push hard on the biggest security/privacy issue to the exclusion of others. If/when it somehow gets resolved, you look like you are trying to make excuses when you bring up the remaining concerns "but ... but ... domestic abuse".
Jeramee
Als Antwort auf Kevin Beaumont • • •So, Microsoft wants to take screenshots by default? How many people will be completely unaware of this?
Switching to #Linux is now a matter of digital self-defense. Fwiw, my switch to @linuxmint was easy.
eerlijkdigitaalonderwijs.nl
Als Antwort auf Kevin Beaumont • • •#Windows and #Microsoft products are thus not suitable for use in #school. Our #education system should be free of #surveillance tech.
We should not be normalising this kind of dangerous #spyware by teaching kids that this is normal.
#SpywareByDesign #Recall
Dave Lane 🇳🇿
Als Antwort auf eerlijkdigitaalonderwijs.nl • • •Explainer: Digitech risks for School Boards
Dave LaneAndrew
Unbekannter Ursprungsbeitrag • • •piral
Unbekannter Ursprungsbeitrag • • •Is this a problem with the programs or the capabilities of the operating system?
Open source would be a good basis for developing appropriate software where the market is not attractive for the large corporations.
Many, many years ago, for example, an initiative developed an eye-tracking system for paralyzed people and made it freely available.
@Jeramee @GossiTheDog @linuxmint
Jeramee
Unbekannter Ursprungsbeitrag • • •@fasnix @linuxmint
You are correct there. On the upside, I heard a recent report from a Linux news channel stating that one group of distros (Ubuntu?) is working to put together a team to rectify that. Linux & FOSS are behind in a few areas, but I hope they change that.
eyrea
Unbekannter Ursprungsbeitrag • • •Jeramee
Unbekannter Ursprungsbeitrag • • •@fasnix @eyrea @linuxmint
The Youtuber I saw explained it as the devs coming in with their own interests and everyone is so fixated on the small part they are working on that they hadn't considered the need for better accessibility.
That doesn't necessarily excuse our community for the dearth of those apps, esp when there are multimillion-dollar companies like Canonical & Red Hat, and when the open source nature of the community should promote cooperation & sharing of those apps.
Kevin Beaumont
Unbekannter Ursprungsbeitrag • • •Copilot+ PCs are the most performant Windows PCs ever built, now with more AI features that empower you every day
Windows Experience BlogKevin Beaumont
Unbekannter Ursprungsbeitrag • • •In depth with Windows 11 Recall—and what Microsoft has (and hasn’t) fixed
Andrew Cunningham (Ars Technica)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Unbekannter Ursprungsbeitrag • • •Microsoft are rolling out Recall to users in Windows Insider (testing) before a wider rollout to all compatible systems.
It's definitely one to watch (and yes, I am) from a security point of view.
bbc.co.uk/news/articles/cj3xjr…
Copilot Recall: Microsoft rolls out AI screenshot tool
Imran Rahman-Jones (BBC News)Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •I've took a look at the past year of work Microsoft has done on Recall, which is due to roll out to compatible Windows devices soon
tl;dr it's much better from a security and privacy point of view. My partner managed to hack my Recall memory in 5 minutes to browse prior Signal discussions, by guessing my Windows Hello PIN.
There's a bunch of risks people who enable it need to understand.
doublepulsar.com/microsoft-rec…
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Kevin Beaumont
Unbekannter Ursprungsbeitrag • • •Signal have rolled out an update to all users that stops Microsoft Recall from capturing Signal conversations.
I’ve tested this and it works. Brilliant work by the @signalapp team. 💪
They call on Microsoft to build better, as there was no standardised way as an app developer to do this. Because Signal is open source, now app developers have a template to protect their users from Windows.
signal.org/blog/signal-doesnt-…
By Default, Signal Doesn't Recall
Signal Messengerteilten dies erneut
Μoritz 💤🏳️🌈 hat dies geteilt.
Kevin Beaumont
Als Antwort auf Kevin Beaumont • • •Tabletop scenario for you:
Employee gets into a dispute with employer, leaves, had sensitive role. Employer revokes access, devices etc. Employee had logged in via BYOD to email, IM etc.
Due to Recall, employee walks away with 6 months of screenshots of everything she's ever worked on in a text indexed form - every email, chat, document, Teams call with video snapshots, transcripts of verbal calls etc - even if they set M365 to not store documents locally.
What does the employer do now?