AI monitoring in the workplace

Turning AI inside out.

Just as organizations use artificial intelligence to monitor the workplace, they must also monitor themselves and, as a result, reshape their risk, governance, and security expectations. AI must be managed from two directions: from the inside out, ensuring that organizations use AI in ways that preserve trust, and outside in, securing the AI systems against external threats.

Defining “AI” in an enterprise context

“AI” is frequently used as a catch‑all term for anything automated or technology‑driven. This obscures meaningful differences in risk, control, and regulatory treatment. For effective governance, organizations must distinguish between traditional automation, predictive models, generative systems, and more advanced agentic architectures.

This precision will help organizations with accurate risk assessments, appropriate control design, and credible external disclosures. From a technological perspective, most enterprises use generative AI and chatbots as assistants for content generation, summaries, and analysis. These tools can greatly improve speed and scale, but they can also expand opportunities for unauthorized access and attacks. As AI interacts with sensitive data, connects to internal systems, and responds to user prompts that are susceptible to prompt-based manipulation, they may create new pathways for exploitation and expand the organization’s attack surface and therefore vulnerability . For example, in 2025 security researchers discovered a vulnerability affecting Microsoft Copilot in which individuals could embed instructions in emails. The instructions were invisible to humans but readable by the AI assistant.

Agentic AI has been described by one author as “a new breed of AI systems that are semi- or fully autonomous and thus able to perceive, reason, and act on their own.” Agentic AI takes these risks a step further by orchestrating sequences of actions across an organization’s tools and systems, which can accelerate and increase the impact of misconfiguration, privilege issues, and misuse.

It’s important to note that legal and technical terminology are not always consistent. Many laws distinguish between AI systems broadly and “automated decision-making (ADM)” or “automated decision-making technology (ADMT)” when decisions materially affect individuals’ rights or opportunities. However, even within the legal realm, AI definitions differ. For example, the California Consumer Privacy Act defines ADMT as technology that processes personal information in a way that implicates human decision making. On the other hand, the Colorado AI Act focuses on “high-risk AI systems” used to make or significantly influence consequential decision making about individuals.

At the international level, the European Union’s AI Act defines an “AI system” broadly as a machine-based system that generates outputs such as predictions, recommendations, or decisions that influence environments. However, the EU legislation applies stricter obligations when those systems involve high-risk use cases affecting fundamental rights. These differing definitions both drive and complicate organizations’ obligations regarding assessments, disclosures, testing, and individual rights. They also directly influence contractual obligations and allocations of liability.

Moreover, organizations should be cautious of definitions within AI frameworks. For example, AI tools may use terms such as “private instances.” But “private” in a marketing or infrastructure sense does not necessarily hold the same meaning as “private” from a legal, security, or data‑governance perspective.

From the inside out: Using AI while preserving trust

Looking at AI from the inside out means examining the ways that AI is deployed within the organization and how that use affects employee relations, customer trust, and third‑party expectations. Many regulatory and policy frameworks take risk‑based approaches that focus on and calibrate controls around context, potential harm, and autonomy of the organization’s system. Common principles include transparency and disclosure, pre‑deployment and ongoing testing, accountability and documentation, and protections for autonomy and privacy.

Key internal legal and compliance concerns include the following:

  • When using AI to monitor performance, don’t cross the line into intrusive employee surveillance.
  • Do what is necessary to prevent leaks of confidential information, including personal data, intellectual property, and sensitive business information, each of which may have distinct regulatory and contractual protections.
  • Preserve consumer and stakeholder trust by clearly signaling when chatbots or automated decision-making tools are in use and by providing meaningful avenues for communication, explanation, and dispute resolution.
  • Manage supply‑chain risks by treating AI vendors and embedded AI services as critical third parties subject to structured risk assessments, contractual safeguards, and ongoing oversight.

Many significant operational risks due to human error can arise after AI is deployed. These can include misuse of AI, overreliance on AI, policy violations, and misalignment between intended and actual use. A mature AI governance program couples technical controls with training, access management, policy adherence monitoring, incident detection and response planning, and robust audit trail implementation.

From the outside in: Securing AI as an attack surface

Looking from the outside in treats AI systems as assets and attack surfaces that require dedicated security strategies. A significant portion of AI‑related activity occurs beyond traditional visibility, especially where models, agents, and orchestration layers are hosted in cloud services or external platforms. Even advanced endpoint and identity tools can struggle to fully capture prompt flows, agent actions, and cross‑system interactions that define modern AI workflows.

Security leaders must clarify monitoring objectives, including the following:

  • Detect use of AI by threat actors within enterprise environments. Threats can include leveraging generative models to craft sophisticated phishing or business email compromise campaigns or to accelerate reconnaissance and lateral movement.
  • Identify and contain abuse or compromise of AI and agentic systems. This can include attempts by threat actors to push agents beyond their permissions, to exfiltrate data, or to misuse connected tools.
  • Manage insider risk where AI systems, if misconfigured, can enable access or aggregation of data beyond an individual’s role.
  • Control expanded data exposure as AI services integrate across SaaS, cloud, and internal platforms, thereby creating new data flows and dependencies.

AI is evolving, with emerging solutions designed specifically to monitor AI behavior, enforce prompts and agent-action policies, and provide auditable records for compliance. Over time, these capabilities are likely to converge into next‑generation endpoint, identity, and security platforms. But Chief Information Security Officers and executive teams should not wait for fully mature products to arrive. They should start now, by prioritizing AI use mapping, aligning technical and legal definitions, clarifying roles and accountability, and building monitoring and governance strategies that simultaneously address inside‑out trust and outside‑in security.

The Constangy Cyber Team assists businesses of all sizes and industries with compliance needs. If you would like additional information about state or federal data privacy laws, please contact us at cyber@constangy.com.

  • Professional portrait of a smiling woman with straight, light brown hair wearing a black blazer and pearl drop earrings. She stands confidently with her arms crossed against a plain white background, giving a poised and approachable appearance.
    Associate Attorney

    She counsels clients on compliance with data privacy and information security laws, and guides them through the development of policies and practices to meet their regulatory and contractual requirements. Her compliance work is ...

  • Professional headshot of Anna Schall Kreamer, Senior Counsel of the Constangy Cyber Team. She is smiling confidently with arms crossed, wearing a grey blazer over a black top, and has shoulder-length blonde hair styled in loose waves.
    Senior Counsel

    Anna draws on a diverse background in government service and private practice. She has counseled organizations across a range of industries—including financial, healthcare, nonprofit, and technology organizations—on ...

The Constangy Cyber Advisor posts regular updates on legislative developments, data privacy, and information security trends. Our blog posts are informed through the Constangy Cyber Team's experience managing thousands of data breaches, providing robust compliance advisory services, and consultation on complex data privacy and security litigation. 

Search

Get Updates By Email

Subscribe

Archives

Jump to Page

Constangy, Brooks, Smith & Prophete, LLP Cookie Preference Center

Your Privacy

When using this website, Constangy and certain third parties may collect and use cookies or similar technologies to enhance your experience. These technologies may collect information about your device, activity on our website, and preferences. Some cookies are essential to site functionality, while others help us analyze performance and usage trends to improve our content and features.

Please note that if you return to this website from a different browser or device, you may need to reselect your cookie preferences.

For more information about our privacy practices, including your rights and choices, please see our Privacy Policy. 

Strictly Necessary Cookies

Always Active

Strictly Necessary Cookies are essential for the website to function, and cannot be turned off. We use this type of cookie for purposes such as security, network management, and accessibility. You can set your browser to block or alert you about these cookies, but if you do so, some parts of the site will not work. 

Functionality Cookies

Always Active

Functionality Cookies are used to enhance the functionality and personalization of this website. These cookies support features like embedded content (such as video or audio), keyword search highlighting, and remembering your preferences across pages—for example, your cookie choices or form inputs during submission.

Some of these cookies are managed by third-party service providers whose features are embedded on our site. These cookies do not store personal information and are necessary for certain site features to work properly.

Performance Cookies

Performance cookies help us improve our website by collecting and reporting information on its usage. We access and process information from these cookies at an aggregate level.

Powered by Firmseek