StartUp / Founder Story

Explore founder stories, leadership decisions, startup building strategies and entrepreneurial lessons through curated summaries and business intelligence.
Building Confluent: From open source side project to public company | Jay Kreps (Co-founder and CEO)
Building Confluent: From open source side project to public company | Jay Kreps (Co-founder and CEO)
2026-03-26T11:00:35Z
Summary
Jay Kreps, co-founder and CEO of Confluent, discusses the transition from software engineer to CEO, emphasizing the need for a diverse skill set and the challenges of decision-making in a growing organization. He highlights the importance of understanding various business functions to make informed strategic decisions. Kreps reflects on the early days of Confluent, detailing how the company navigated the complexities of product development and market entry. He notes the significance of initial customer feedback and the necessity of adapting to market demands while maintaining a clear vision. The conversation delves into the challenges of launching a cloud product alongside existing software, illustrating the internal debates and external pressures faced by the team. Kreps emphasizes the need for tenacity and adaptability in overcoming obstacles and achieving growth. Kreps shares insights on effective communication and product marketing, stressing the importance of conveying a product's value to diverse audiences. He argues that successful founders often excel in articulating their vision and engaging with customers.
Perspectives
short
Pro-entrepreneurship and innovation
  • Emphasizes the importance of diverse skill sets for CEOs
  • Highlights the necessity of understanding various business functions
  • Stresses the value of customer feedback in product development
  • Advocates for effective communication in product marketing
  • Encourages decentralized decision-making for accountability
  • Promotes the need for adaptability in overcoming challenges
Challenges in scaling and market entry
  • Describes the difficulties of transitioning from engineer to CEO
  • Notes the internal debates regarding product strategy
  • Discusses the complexities of launching a cloud product
  • Highlights the risks of misalignment between leadership vision and team capabilities
  • Mentions the potential pitfalls of relying solely on tenacity
Neutral / Shared
  • Acknowledges the importance of persistence in entrepreneurship
  • Recognizes the evolving nature of market demands
Metrics
customer_acquisition
an important problem to get to solve
initial sales engagement
Understanding customer acquisition is vital for scaling the organization.
it was kind of natural. That would be the case.
other
nine months
time spent discussing the rollout of the new data solution
This duration indicates significant organizational resistance to change.
we spent nine months talking about it.
team_size
we probably had three to five people
size of the initial engineering team
A small, passionate team can drive innovation but may also limit outreach.
we probably had three to five people
blog_post_length
probably, I think it was like 25 pages long pages
length of the blog post that helped gain traction
A detailed and engaging blog post can significantly influence product adoption.
I think it was like 25 pages long
growth
the open source has kind of grown steadily
overall growth trajectory of the open-source project
Demonstrates consistent interest and adoption despite challenges.
the open source has kind of grown steadily
market share
five, seven percent of IT spend %
cloud's share of IT spending
Indicates the competitive landscape and challenges faced.
the cloud was going to be a big thing, right? But at that point, everybody believed it was just really, it appears like there was not going to be any other companies.
funding
no product, no nothing
initial funding raised
It highlights the importance of traction in attracting investors.
you raised the money with no product, no nothing.
development_time
took like five years days
time to launch first product version
It reflects the challenges of aligning expectations with actual delivery.
the first thing we launched was much less than that and did do everything on the slide took like five years.
Key entities
Companies
Amazon • Confluent • LinkedIn
Countries / Locations
ST
Themes
#ai_startups • #founder_story • #startup_ecosystem • #venture_capital • #accountability • #business_growth • #business_success • #cloud_product • #cloud_service • #cloud_strategy
Timeline highlights
00:00–05:00
Transitioning from software engineer to CEO involves a significant shift in skills, requiring a deep understanding of various business functions. Effective leadership necessitates making decisions with incomplete information while maintaining a clear vision for the company's direction.
  • Transitioning from software engineer to CEO requires a significant shift in skills, essential for navigating the broader business environment and making strategic decisions
  • Effective CEOs should understand about 80% of their executives expertise to lead successfully, enabling them to assess performance and manage diverse business areas
  • Confluents early strategy involved presenting an incomplete product to major enterprises, showcasing the role of confidence and risk in attracting initial customers
  • A pivotal blog post greatly increased Kafkas adoption, highlighting the critical role of clear communication in marketing for product success
  • The choice to prioritize a cloud product was met with skepticism but proved essential for Confluents growth, demonstrating the need for strong leadership conviction
  • As companies expand, CEOs often face uncertainty and must make decisions without complete information, emphasizing the importance of being directionally correct
05:00–10:00
Transitioning from software engineer to CEO requires a comprehensive understanding of various business functions to make strategic decisions. Founders must engage in initial sales to gain insights into customer needs, which is crucial for future growth.
  • Transitioning from software engineer to CEO necessitates a comprehensive understanding of various business functions, which is vital for making impactful strategic decisions
  • CEOs should grasp around 80% of their executives expertise to make informed decisions and effectively evaluate success across different business areas
  • A tailored go-to-market strategy is essential for addressing specific company needs, rather than relying on generic approaches to guide customers effectively
  • Founders must often engage directly in initial sales, which provides critical insights into customer needs and helps shape the organization for future growth
  • In the early stages, companies like Confluent face the challenge of customer acquisition, which is crucial for building a more efficient organization as they scale
  • Recognizing the unique nuances of each business discipline is key to assembling a successful team, as misapplying strategies can lead to execution failures
10:00–15:00
Jay Kreps faced challenges in implementing data-driven products at LinkedIn, highlighting the importance of strong data management. His experience led to the establishment of Confluent, addressing the need for scalable data streaming solutions.
  • Jay Kreps joined LinkedIn to leverage his machine learning expertise but found challenges in effectively implementing data-driven products, emphasizing the need for strong data management in product development
  • While developing data infrastructure, Kreps identified a significant gap in scalable data technologies, revealing a key opportunity for innovation in data flow management
  • The initial product at LinkedIn aimed to improve inefficient internal data pipelines but encountered resistance from existing teams, highlighting the political challenges of introducing new solutions in engineering
  • Despite initial opposition, Kreps and his team recognized the potential of their project, leading to the establishment of Confluent and marking a crucial step towards a scalable data streaming platform
  • Although the early product was not fully developed or scalable, it provided a foundation for future advancements, addressing the increasing demand for effective data management solutions
  • Kreps experience at LinkedIn underscored the importance of understanding the broader context of data flow, which became a guiding principle for his work with Confluent
15:00–20:00
The team recognized the growing number of use cases for their data solution, indicating its significance in data management. Despite initial enthusiasm, the open-source launch did not gain traction until effective product marketing clarified the technology's value.
  • The team recognized their projects importance as the number of use cases for their data solution grew, indicating they were solving a critical issue in data management
  • Initially, the engineers were driven and passionate, with their motivation enhanced by the open-source nature of the technology, fostering a strong sense of ownership
  • Despite their internal achievements, the open-source launch of their product failed to gain immediate traction, which was unexpectedly disheartening for the team
  • The team understood that effective product marketing was essential for their open-source projects success, realizing that clear communication of their technologys value was necessary for adoption
  • A key moment occurred when a team member authored a detailed blog post that clarified the technologys potential, generating interest and boosting the projects popularity in the tech community
  • The product itself remained largely unchanged during this time; however, improved communication shifted perceptions and underscored the need to articulate the technologys unique benefits for broader acceptance
20:00–25:00
Effective communication is crucial for the success of technical products, distinguishing successful founders from their peers. A well-structured marketing message, supported by substantial evidence, is essential for conveying a product's value.
  • Effective communication is vital for the success of technical products, as it often differentiates successful founders from their peers. Many overlook the intricacies of product marketing, which demands careful consideration and detail
  • Marketing messages should follow a pyramid structure, featuring a clear main message supported by substantial evidence. This organization is essential for ensuring that marketing efforts effectively convey the products value
  • Refining a marketing message requires a deep understanding of the product, which is then distilled into a concise statement. This iterative process ensures that the final message accurately represents the products core truths
  • When preparing for an IPO, it is crucial to present the company in a way that resonates with public market investors. This involves linking the product to familiar concepts, such as databases, to emphasize its unique value
  • Confluent framed its technology as addressing the critical issue of data in motion, contrasting it with traditional data at rest. This strategy clarified the companys strategic importance and market opportunity
  • Simplifying complex ideas for investors not only helps secure funding but also enhances the companys overall messaging. By understanding the audiences perspective, companies can more effectively articulate their value proposition
25:00–30:00
The relationship between data at rest and data in motion is crucial for effective technology integration within companies. As organizations grow, maintaining clear communication becomes increasingly difficult, often leading to diluted messaging.
  • Understanding the relationship between data at rest and data in motion is essential for leveraging technology effectively, as it emphasizes the need for software to integrate various company functions
  • As companies expand, effective communication becomes more challenging, often leading to diluted messaging that reduces impact
  • A successful blog post significantly increased interest in the technology, demonstrating strong market demand and paving the way for the transition to a formal company
  • The open-source product experienced gradual growth, highlighting the complexities of adopting advanced technology and the necessity for a strategic scaling approach
  • The decision to establish a company around the open-source project arose from recognizing a widespread market need, driven by interest from sectors like media and banking
  • Founders faced skepticism regarding the viability of open-source companies at the time, making it a difficult environment for new enterprise solutions