FireOak Executive Brief
Artificial intelligence is quickly becoming part of how organizations operate – from internal productivity tools and knowledge management to customer service, research, and decision support. While management is responsible for selecting and implementing these technologies, boards have an important oversight role.
Board members don't need to become AI experts. But they should have confidence that AI initiatives support the organization's mission, are governed appropriately, and strengthen the organization over the long term rather than introducing unnecessary risk or complexity.
The questions below are designed to help boards focus on the conversations that matter most. They aren't intended to evaluate specific AI tools or vendors, but to encourage thoughtful oversight of the organization's direction, governance, and readiness.
1. Why are we using AI?
Every AI initiative should begin with a clear organizational purpose – not simply because the technology is available or competitors are adopting it.
The board should expect management to explain what business or mission challenge the organization is trying to address and why (and how) AI is an appropriate part of the solution. Whether the goal is improving operational efficiency, enhancing client or customer services, accelerating research, reducing administrative burden, or supporting better decision-making, the expected outcomes should be clearly connected to the organization's strategic priorities.
If the primary justification is "everyone else is doing it" or "we don't want to get left behind," the organization might be adopting technology before defining the problem it is trying to solve.
What to listen for
A strong answer should include:
- A clearly defined business or mission objective.
- An explanation of why AI is the right approach.
- Expected outcomes that can be evaluated over time.
- A clear connection to the organization's strategic plan, mission, or long-term priorities.
2. What capabilities are we trying to build as an organization?
AI should do more than improve productivity today, although that can be a useful starting point. (Read more: Why the Best First Enterprise AI Projects Are Often the Boring Ones.) The strongest AI initiatives leave the organization better equipped for tomorrow.
Boards should understand how an AI initiative contributes to the organization's long-term capabilities. That might include improving knowledge sharing, strengthening decision-making, reducing reliance on individual experts, streamlining critical processes, or creating new ways to serve clients, constituents, or researchers.
An initiative that delivers short-term efficiency but increases dependency on a single vendor, weakens internal expertise, or creates fragile processes may not represent lasting organizational value.
What to listen for
A strong answer should include:
- A clear explanation of how the initiative strengthens the organization's long-term capabilities.
- Benefits that extend beyond immediate productivity gains.
- Evidence that management has considered how people, process, and organizational knowledge will evolve – not just the technology.
- An understanding that AI is one part of building a stronger organization, not the objective itself.
3. Who is accountable for AI across the organization?
Successful AI adoption is not solely an IT initiative. It affects operations, information governance, cybersecurity, legal and compliance considerations, human resources, and the way people work across the organization.
Boards should understand who is responsible for overseeing AI adoption, how decisions are made, and how progress and risks are reported. Clear accountability helps ensure AI initiatives remain aligned with organizational priorities rather than becoming isolated technology projects.
If responsibility is spread across multiple departments without clear executive ownership, important decisions – and risks – can easily fall through the cracks.
A strong answer should include
- A named executive with overall accountability for AI governance and adoption.
- Clearly defined roles an responsibilities across leadership.
- A process for reporting significant AI initiatives, risks, and outcomes to the board.
- Recognition that AI governance is an organizational responsibility, not simply an IT function.
4. What information should AI have access to, and what information/data should AI never see?
Every AI system depends on information. Before adopting new AI tools, boards should understand what organizational information employees are expected to use with AI, and where appropriate boundaries have been established.
Not every type of information belongs in every AI system. Client information, donor records, research data, intellectual property, financial information, employee records, and confidential business discussions may all require different levels of protection depending on the organization's risk appetite, policies, contractual obligations, and the AI tools being used.
The goal isn't to eliminate all risk, but rather to ensure the organization has intentionally considered what information is appropriate to use with AI and what should remain outside those systems.
A strong answer should include
- Clear guidance about what information may and may not be used with AI tools.
- An understanding of how confidential, proprietary, or regulated information will be protected.
- Consideration of existing information governance, privacy, and cybersecurity policies – ideally, not separate AI rules created in isolation.
- Recognition that AI governance begins with good information governance.
5. Are we strengthening the organization, or creating new dependencies?
The most successful AI initiatives do more than automate existing work. They help the organization become more resilient, more knowledgeable, and better able to achieve its mission over time.
Boards should consider whether AI is strengthening institutional knowledge, improving decision-making, and making important processes more sustainable – or whether it is creating new dependencies on individual employees, vendors, or technologies that could become difficult to manage in teh future.
Every technology investment creates some level of dependency. The goal is to ensure the dependencies are understood, intentional, and aligned with the organization's long-term interests.
A strong answer should include
- An understand of how the initiative strengthens organizational capability, not just individual productivity.
- Consideration of long-term vendor, technology, and operational dependencies.
- Plans to capture organizational knowledge rather than embedding it within a single tool or individual.
- Recognition that sustainable systems are more valuable than short-term efficiency gains.
6. How will we know whether AI is creating value?
Boards should expect management to define what success looks like before significant AI initiatives are launched. That success may include improved service delivery, reduced administrative effort, faster research, or other outcomes that support the organization's strategic goals.
Without agreed-upon measures of success, it becomes difficult to determine whether an AI initiative is delivering meaningful value or just introducing additional costs and complexity.
A strong answer should include
- Clearly defined objectives and expected outcomes.
- Measures that focus on organizational impact, not simply technology adoption.
- A plan for periodically reviewing whether expected benefits are being achieved.
- Willingness to adjust – or discontinue – initiatives that are not delivering sufficient value.
7. What risks are we accepting, and are we comfortable accepting these risks?
Every strategic decision involves tradeoffs. AI is no exception.
Boards are not responsible for eliminating every risk associated with AI, but they have an important role in ensuring significant risks are understood, discussed, and managed appropriately. Those risks may include privacy, cybersecurity, intellectual property, regulatory compliance, reputation, operational resilience, or the quality of organizational decision-making.
The goal is to ensure that the organization is making informed decisions with a clear understanding of both the opportunity and the responsibilities that accompany AI adoption.
A strong answer should include:
- A balanced discussion of both opportunities and risks.
- Identification of the organization's most significant AI-related risks and how they will be monitored.
- Recognition that different AI initiatives may involve different levels of risk and oversight.
- Confidence that management understands the organization's risk tolerance and is governing AI accordingly.
What Strong Board Oversight Looks Like
Artificial intelligence will continue to evolve, and individual tools, vendors, and capabilities will change over time. A board's responsibility is to ensure the organization is making thoughtful, intentional decisions that support its mission, reflect its values, and are governed appropriately.
Strong board oversight doesn't require technical expertise. It requires asking good questions, expecting clear accountability, and ensuring AI initiatives receive the same level of strategic oversight and due diligence as any other significant organizational investment.
A board should have confidence that management can demonstrate:
- AI initiatives support the organization's mission and strategic priorities.
- Executive ownership and accountability are clearly defined.
- Information, privacy, intellectual property, and governance considerations have been addressed before implementation.
- The organization is building long-term capabilities, not simply adopting new technology.
- Success will be measured using meaningful organizational outcomes.
- Risks have been identified, discussed openly, and are being managed appropriately.
- AI is strengthening the organization's resilience, knowledge, and decision-making over time.
Organizations don't need to have every answer before beginning their AI journey. They do, however, benefit from approaching AI with the same thoughtful governance, clear leadership, and strategic discipline they bring to every other important organizational decision.