ARLIResearch
Talk analysis 5

Whose GPU is it,
and who else can see your workload

An analysis of the second short talk of the day: infrastructure as an attack target, and the four layers on which the trust model breaks at the same time. It examines the content, the mechanisms, and what remained at the level of disclosure rather than exploitation.

EVENT: OPEN SOURCE X SOVEREIGN AI, DAY 1, SF TECH WEEK · FORMAT: SYNTHESIS OF ARGUMENTS · CASES, CVEs AND FIGURES CHECKED AGAINST PRIMARY SOURCES
4Stack layers: code, containers, marketplaces, hardware
244KDownloads of the fake model repository in 18 hours
341Malicious skills in a single registry out of 2 857
35%Cloud environments exposed to the container toolkit flaw
3 linesLength of the Dockerfile needed for a container escape
IOMMUThe protection that the attack on graphics card memory bypasses

How to read this file

This is the fifth talk of the day and the second of the short presentations block. The previous four examined who owes what to whom, where memory lives, what we control, and where knowledge comes from. This talk poses the question differently: who else has access to what you run, if the hardware beneath your workload does not belong to you. The talk is built as an examination of four layers, at each of which the layer below is assumed to be secure, and at each of which that assumption turns out to be wrong.

1. The place of the talk in the day

The talk runs in the same short-presentations block as the analysis of expertise extraction, and together they close the day from two sides. There the subject was where knowledge comes from and how to preserve its ownership. Here the subject is what happens to knowledge, models and data when they end up on someone else's hardware.

It helps to see the link to the third talk of the day. There sovereignty was examined as a set of provable authorities and carried down to the layer of the megawatt and the power contract. Here the same layer is treated as an attack surface: if the authorities do not exist or are not checked, then the question is no longer who controls the workload legally, but who has physical access to it.

Four layers, each trusting the one below
code and model repositories we trusted the source because it was popular containers and runtimes we trusted the kernel boundary to hold decentralized compute marketplaces we trusted the operator to have something to lose hardware and drivers we trusted silicon to be the floor trust extended downward failing at every layer simultaneously

2. Who is speaking

The speaker introduces himself as an engineer with twenty years of work in Silicon Valley and with experience of large-scale infrastructure: he speaks of building systems of the same class as public clouds. He is now the founder of a company that is building a decentralized cloud with the promise that data and services belong to their owner and that this can be verified.

This position makes the talk interesting by its construction. A person who is building decentralized infrastructure appears with an examination of its weak points and says plainly that he is himself an advocate of such computing. From this comes a rare genre: criticism not from outside but from within the field, and for that very reason it is more convincing than an ordinary list of risks.

3. Transcript corrections: what the recording heard incorrectly

As heard in the recordingWhat it actually isStatus
Open OSS, Privacy Filter, model card copied from open AIA fake repository Open-OSS/privacy-filter on Hugging Face that imitated an open OpenAI model. It appeared in May 2026 and reached first place in the trends in roughly 18 hoursverified
244,000 downloads in 18 hoursOn the order of 244,000 downloads before the repository was removed. According to published reports, it distributed an infostealer for Windowsverified
a file called loader dot pieloader.py: a file imitating an ordinary model loaderverified
reactivates SSL verificationA slip in the recording. The meaning is the opposite: the code disabled certificate verification in order to download the payloadverified
Hidden Layers advisoryHiddenLayer, an AI security vendor whose analysis directed that the machine be considered fully compromisedverified
over 300 malicious skills in a popular AI agent skill repositoryA February 2026 audit: 341 malicious skills out of 2 857 in an agent's skill registry, that is about 12 percent of the registryverified
Liz research discloses a CVE ... videoscapeThe company Wiz and the vulnerability NVIDIAScape, CVE-2025-23266, disclosed in July 2025: a container escape in one company's container toolkitverified
roughly 35, 37% of 5 alignments are impactedAn estimate of the share of cloud environments affected by the vulnerability, about 35 percentverified
another CD at pretty much the same timeA neighboring flaw in the same toolkit, disclosed at about the same time. The exact identifier is not confirmed in this analysisunverified
researchers at Chainlight, Akash network, May 2024ChainLight and the decentralized compute platform Akash Network, May 2024: a bypass of the deployment owner checkverified
IAAA security and privacy event, GDDR hammerThe IEEE S&P Symposium of 2026, May. The family of attacks on graphics card memory is known under the names GDDRHammer, GeForge and GPUBreachverified
CSA, the FBI, and the White House cyber directorCISA, the FBI and the White House cyber director: the subject of attacks on GPU hardware first entered the agenda of a keynote Black Hat talk in August 2026verified
row hammerRowhammer: a class of attacks in which frequent accesses to memory cause bit flips in neighboring cellsverified

4. The question and the thesis

The question the speaker suggests keeping in mind throughout the talk is this: when you run an AI workload on infrastructure you do not manage, who else has access to what you run. This is the right framing, because it moves the security conversation from the plane of "is the provider protected" to the plane of "what does the party beneath you see".

The thesis: the trust model on which AI infrastructure rests breaks at all layers at the same time, and the threat models in most security teams have not been updated for this. The four layers are then examined in turn, and at each one is shown either active exploitation or a disclosed vulnerability that has not yet become a weapon in wide use.

A presentation rule worth adopting

From the very start the speaker separates two classes of threat: what is already being exploited, and what has been disclosed responsibly but not yet weaponized. He says this distinction must be emphasized explicitly, because the response depends on it: the first is answered urgently, the second is designed for in the architecture. This is precisely the difference between an incident and an engineering task.

5. Layer one, code: the fake repository

The first case begins with a repository on Hugging Face that appeared in May 2026 under a name imitating an open OpenAI model. The model card was copied word for word from a legitimate release, and the difference lay in a single file that looked like an ordinary modern model loader. Inside was plausible bait code with no obvious signs of forgery, then a disabling of certificate verification, a decoding of an encoded block, and the download of a script that executed on every machine running Windows where this loader was launched.

What happened next is known from the security vendor's analysis: within roughly eighteen hours the repository became first in the platform's trends, gathered on the order of 244,000 downloads and was removed before most had time to learn of it. The analysis was unambiguous: if this loader had been run, the machine must be considered fully compromised, not examined.

The speaker separately emphasizes that such a reach does not require sophisticated ingenuity. It is enough to repeat an already existing template: imitate a trustworthy release, use a popular platform as the channel, and count on the download being perceived as a mark of quality.

The model was the delivery vehicle, the compute was the target
trusted source official looking repo, huge download count the delivery mechanism invisible payload no exploit of the platform needed runs as the developer your infrastructure workstations, researchers, pipelines the actual target the download was not the incident, the machine it ran on was

6. The same template in agent ecosystems

The speaker then shows that the model case is not isolated but belongs to a class. In February 2026 an independent audit of a popular agent's skill registry found 341 malicious skills out of 2857, that is about twelve percent of the registry, with some campaigns specifically hunting for cryptocurrency and model training infrastructure.

The conclusion is stated briefly and it holds not only for AI: open ecosystems of skills and packages are a built-in gap in trust. The platform is not a means of control, and the number of downloads is not a security check. The speaker draws a direct parallel with package managers, where this lesson has long been known.

Why popularity is a poor indicator

The download counter reflects not trust but the speed of distribution. In the first case it was precisely the growth in popularity that was the mechanism: the higher the position in the trends, the more downloads, and this accelerates distribution faster than oversight can intervene. That is, the metric usually read as a sign of reliability here worked as an accelerator of the attack.

7. Layer two, containers: escape through the toolkit

Turning to containers, the speaker examines a vulnerability disclosed in July 2025 by the company Wiz and given the name NVIDIAScape. This concerns a component that connects containerized workloads to graphics cards, and it is installed almost everywhere that containerized GPU jobs run, including at large cloud providers.

The mechanism is described as elegant and frighteningly simple. A malicious container adds, through a preload variable, a reference to a library it controls, and when the container runtime hook fires, that library is loaded on the host rather than inside the container. From there the attack has root privileges and full control of the machine. By the researchers' estimate, on the order of 35 percent of cloud environments were exposed to the vulnerability, and a few lines in the description of the container build sufficed to launch the attack.

Alongside this, the speaker mentions a second flaw in the same toolkit, disclosed at about the same time and enabling file substitution on the graphics card side. The conclusion he draws from this is more important than the vulnerabilities themselves: a container is not a boundary of isolation that can be relied on alone.

Container escape: the hook fires on the host
malicious container sets a preload variable points at its own library looks like a normal build three lines of Dockerfile runtime hook fires outside the container loads the library on the host host machine root access obtained full control of the node every colocated workload visible about 35% of cloud environments the payload does not stay inside the container: it loads where you cannot see it

8. Layer three, marketplaces: a different relationship of trust

The speaker calls this part the main reason he came to speak, and explains a difference that is easy to miss. In a traditional cloud an organization has an account, a contract, a support number, a compliance framework and a legal entity on the other side of the transaction that has something to lose. Decentralized compute marketplaces are structured fundamentally differently: they are an exchange of compute capacity between participants, in which the hardware owner registers as a supplier, customers publish jobs, suppliers compete on price, and the match is closed automatically.

The economic rationale is very strong: the shortage of compute is real, and such marketplaces offer access to it at a fraction of the cost of large clouds, so organizations are already using them. The question that is not asked in the process is "who is running the hardware beneath your workload", and the answer in the decentralized model is unknown: the supplier is anonymous or at best pseudonymous, there are no checks, there are no personal contractual obligations to the customer, and the only incentive is the reward for compute time supplied.

What the customer hasTraditional cloudDecentralized marketplace
A contract with the hardware operatorYes, with a legal entityNo, the relationship is mediated by the platform
Verification of the operator's identityPart of the compliance modelNot performed
An incentive not to read the dataRegulatory, contractual and reputationalAbsent, the only incentive is for time supplied
What the operator loses in the event of abuseContracts, reputation, licensesPractically nothing except access to the marketplace
A means of holding to accountClaim, court, regulatorIdentification is difficult, the usual mechanisms do not work

9. A case from the third layer: bypassing the deployment owner

Next comes a concrete example of a vulnerability found in May 2024 by the research group ChainLight in the decentralized compute platform Akash Network. The flaw allowed an attacker to impersonate the deployment owner, bypass the access check and execute arbitrary commands on any active instance. That is, to read logs, exfiltrate data, gain access to model weights and interfere with running processes.

The disclosure was responsible, the platform issued a fix quickly, and this is a good outcome. But the speaker asks us to think about what such a vulnerability means specifically in the decentralized context, and he explains the difference precisely. In a traditional cloud a flaw like this is very serious, but whoever uses it must first compromise the platform, and the platform has a security team, monitoring, response and legal liability. In a decentralized marketplace the attacker already owns the hardware beneath your workload. He does not need to break the platform; it is enough for isolation to fail.

Impersonating the deployment owner
attacker claims a known identity no credentials required access check bypassed the check trusts the claim on any active instance arbitrary commands read logs, move data reach weights, processes patched disclosed responsibly good outcome in a marketplace the hardware operator does not need this flaw: the position is already theirs

The key consequence

In the decentralized model there is no need to exploit the platform, because the position of the hardware operator already grants access to everything that isolation did not hold back. This is precisely why in this talk the examination of containers comes before the examination of marketplaces: the earlier layer enables the next.

10. The scenario end to end

So that all of this does not look like a set of separate vulnerabilities, the speaker assembles a single scenario from beginning to end. A financial organization runs model inference on a decentralized marketplace, because it is substantially cheaper and the budget for compute is under pressure. The team checked all the security elements it knew how to check and packaged the workload into a container.

The operator who received this node uses an unpatched version of the container toolkit and performs an escape. He then spins up his own container alongside, runs the exploit and ends up on the host. After that the model weights, the input data and the results of the work become visible to a party the customer has never met, cannot identify and has no contractual relationship with.

The speaker emphasizes that the scenario is not hypothetical: every element of it is documented. And the blast radius in such a model is wider than in a traditional cloud, and the explanation for this is given through the incentives we have already discussed: a large operator has reasons not to read the data, while an anonymous node has no such reasons.

11. The four risks that arise here

RiskHow it is realizedHow it differs from an ordinary cloud
Extraction of training dataThe data resides in the host's memory, and the host is under the attacker's controlThe operator is not bound by obligations that can be enforced
Theft of model weightsThe fine-tuned model sits as files on disk, and root has read accessNot only access is lost, but also the invested cost of development
Manipulation of inputs and outputsA compromised host intercepts and alters requests and responsesThe model's output ceases to be trustworthy, which is harder to detect
Lateral movementWith several tenants on one host, the compromise becomes a footholdOne affected node opens access to neighboring workloads

12. The fourth layer, hardware: attacking graphics card memory

The last part of the talk is about something that is not yet exploited at scale, and the speaker states this openly. It concerns an extension of a known class of memory attacks, where frequent accesses to memory cause bit flips in adjacent cells. Here the same technique is applied not to the computer's main memory, but to graphics card memory, and the speaker calls the work by its name.

The mechanism is described as follows. The problem is not the flipped bits themselves, but that an unprivileged compute kernel can, by acting on memory, gain access to arbitrary regions of memory on the card, and from there reach driver vulnerabilities and obtain full privileges on the host. An essential detail: this works even with protection enabled that is supposed to restrict direct device access to the machine's memory.

According to the public materials, the body of attacks is as follows. The first work, which the speaker names, strikes the page tables of graphics card memory: at one vendor their placement turns out to be next to user data, so a flipped bit in the right position redirects the address mapping to the processor's physical memory, after which the card reads and writes to it directly. The second work from the same period goes one level deeper and corrupts page directory entries. The third, from the group that first demonstrated this problem on graphics cards, bypasses the protection mentioned above entirely. The claimed scope of impact is considerable: instead of 8 flipped bits in the early work, here it is on the order of 129 bits per memory bank, and a widely used model, which cloud platforms use, is named as the publicly confirmed vulnerable card.

From an unprivileged kernel to a root shell
unprivileged compute kernel another tenant memory hammer flips bits adjacent rows page tables corrupted co-located with data direct mapping to CPU memory via the bus aperture root shell on the host IOMMU bypassed three independent teams reached the same place in April 2026 no authentication needed, only shared hardware the earliest work flipped 8 bits; this family reaches about 129 per bank

13. Why this matters specifically for AI infrastructure

The speaker explains the applicability briefly and precisely. The dominant deployment model is shared graphics cards: multi-tenant clusters used by decentralized platforms, by capacity rental services, and by scientific computing environments alike. In such an environment, "unprivileged" does not mean an abstract user, but another tenant on the same hardware.

There are no confirmed cases of exploitation in real attacks as of the time of the talk, and the speaker emphasizes this. But there are two signals that he considers more important than the fact of exploitation itself. First: the research is published, the technique is documented, and the attack surface is the most widespread computing infrastructure in the world. Second: the topic has moved out of academia and into politics. In May 2026 the works appeared at a dedicated security and privacy symposium, and in August, at a security conference, attacks on GPU hardware were for the first time on the agenda of a keynote presented by representatives of a dedicated cybersecurity agency, the FBI, and the White House cyber director.

The conclusion the speaker draws from this layer: hardware is no longer a trusted boundary. The attack surface now lies below the operating system, below the container, and below the driver, and the assumption that silicon is the floor turned out to be wrong.

Unprivileged means another tenant on the same card
one graphics card shared memory and page tables your work privileged tenant B unprivileged marketplaces rental services research clusters the dominant model shared hardware is where AI runs today a kernel with no privileges is not a stranger: it is whoever else rented the card

14. Summary: four layers and four wrong assumptions

LayerWhat was believedWhat happened
Code and repositoriesA popular source with hundreds of thousands of downloads deserves trustThe model card is copied, the loader executes the payload on the developer's machine
ContainersThe kernel boundary is easier to hold than everything elseA runtime hook loads a library on the host, root privileges, control over the node
Compute marketplacesThe operator has reasons not to read my workloadThe operator is anonymous, there are no obligations, isolation fails, the workload is visible to an outsider
Hardware and driversSilicon is the physical floor below which one cannot goAn attack on graphics card memory yields root on the host with protection enabled
The same pattern repeated on four levels
trusted source popularity, official look contract, brand, defaults assumed safe invisible payload no platform exploit needed takes the position already held no alarm raised infrastructure as victim workstations, nodes, GPUs the layer you believed you controlled full compromise the fix not better scanning verification per layer architectural, not a product every layer assumed something below it was safe, and every layer was wrong

15. What is proposed to be done

The speaker's answer rests on a single distinction, and it is the most valuable part of the talk. The solution is not to scan better at one layer, and not to patch faster (although patching faster is always necessary). The solution is to recognize that trust must be earned at every layer, and that any architecture which passes trust down by default stands on a foundation that has already cracked.

The second thesis: independent verification of each layer is needed so that the failure of one layer does not bleed into the others. The speaker emphasizes that this is not a product question but an architecture question, and that the absence of such an architecture means only a matter of time until an incident.

The practical translation

From the talk comes a ready set of questions to ask of any workload on someone else's hardware. What exactly holds the isolation of my job, and have I verified it myself. Who receives my data in memory, and does that party have obligations that can be enforced. What will happen to the model weights if the host under my workload is controlled by someone else. And the most uncomfortable one: what if the operator is hostile not through negligence but by decision.

16. What is not proven here

ClaimWhat verification showsStatus
On the order of 244,000 downloads in 18 hoursPublications by independent outlets and analyses by security vendors confirm the order of magnitude and the timeframeconfirmed
341 malicious skills out of 2857 in the registryAn audit of February 2026, about 12 percent of the registry, several campaignsconfirmed
Container escape, about 35 percent of environments, a few build linesA vulnerability in a GPU container toolkit, disclosed in July 2025, the mechanism via a runtime hook is confirmedconfirmed
A second defect in the same toolkit almost simultaneouslyIts existence is confirmed, the exact identification is not verified in this analysisnumber unverified
Bypassing the deployment owner on a decentralized platformA May 2024 finding, responsible disclosure, a fix was released quicklyconfirmed
A GPU memory attack yields root with protection enabledThree independent works of April 2026, publications at a dedicated symposium and a demonstration at a security conference are claimedconfirmed
There are no confirmed exploitations of the memory attack in real incidentsMatches the public state of the topic at the time of the talkmatches
The GPU memory attack is larger in surface than attacks on workstationsAn evaluative judgement of the speaker, he provides no quantitative comparisonjudgement
The scenario involving a financial organizationAssembled by the speaker as an illustration: each element is documented, but no such incident as a whole has been recordedillustration

17. Three questions the talk does not address

First: how to verify the lower layers in practice. Independent verification of hardware and driver requires either trusted measurement or the ability to compare the system's behavior against a baseline, and that is a separate engineering task, which the talk names as a requirement but does not work through as a job.

Second: what the incentives of the party that provides this verification look like. The speaker correctly notes that an anonymous operator has no reason not to read the data. But the verification provider also has its own interests, and the analysis offers no answer to the question of who verifies the verifier in the infrastructure layer. This is exactly the same question raised in the talk about agent obligations, as applied to certification.

Third: what to do with already deployed workloads. All the talk's recommendations are architectural, and therefore apply to new projects. For systems already running on someone else's hardware, neither a course of action nor a criterion is offered, whether to stop work urgently or to continue.

The main weakness of the position

The talk convincingly shows why one cannot trust, but does not provide a measurable criterion for the sufficiency of control. The requirement to "verify each layer independently" is correct and at the same time unbounded: it has no threshold after which the work can be considered done. Without such a threshold the solution remains a matter of budget and taste, and not an engineering procedure.

18. Numbers and facts on one screen

18 hoursFrom the repository appearing to its first place in the trends and its removal
244 000Downloads of the fake model loader
341 / 2 857Malicious skills out of the total in the agent registry
35%Cloud environments exposed to the container toolkit vulnerability
3Lines in the build description sufficient for an escape
8 → 129Flipped bits per bank: from the first work to the current family
3 teamsIndependent research groups that disclosed the attack in April 2026
4 layersCode, containers, marketplaces, hardware: at each one, trust was not justified

19. Glossary of the talk

TermMeaning in substance
InfostealerA data thief: a program that collects and sends information from an infected machine
Model loaderCode that loads the weights and prepares the model to run. It can be used as a lure, because it looks ordinary
Container escapeBreaking out of the isolation boundary and obtaining privileges on the host
Runtime hookA container runtime mechanism that calls external code at certain points and can execute outside the container
Library preloadingSubstituting a library via an environment variable: the program loads the attacker's code instead of the system one
Compute marketplaceA venue where owners of capacity offer it and customers post tasks. The relationship is mediated by the platform, not by a contract with the operator
Memory attackA class of attacks in which frequent accesses to memory cause bit flips in adjacent cells
Page tablesStructures that map virtual addresses to physical ones. Corrupting them redirects memory accesses
Direct device access protectionA mechanism restricting peripheral access to the computer's memory. Bypassed by some of the described attacks
Lateral movementMoving from one compromised system to neighboring ones
Shared multi-tenant workloadA model in which several tenants run on the same hardware, which is what makes the described attacks possible

20. Twenty self-check questions

21. Where to check the primary sources

The bottom line in one sentence

The talk proves, across four worked examples, that trust passed down by default breaks at every layer of the stack, and it does so in the most inconvenient place: where the only practical solution is to verify each layer independently, and no threshold exists after which verification can be considered sufficient.

This analysis is based on the transcript of a short talk. Names, proper names, and vulnerability numbers distorted by automatic transcription have been restored from primary sources and marked with a verification status. Not verified: the exact number of the second defect in the container toolkit, and the quantitative comparison of attack surfaces, which the speaker gives as an estimate. The scenario involving a financial organization was assembled by the speaker as an illustration, and not as a recorded incident.

ARLI membership: the notes from the workshop

One site of yours, measured, with the price for the work in the same document

ARLI, Inc., a Delaware corporation. Questions: hq@arliwork.com.