PlusOne

The commercial software industry is plagued by numerous significant problems: Cost and schedule overruns, poor software quality, unrealistic expectations, products that fail to meet customer needs, and more. These problems are historic, chronic, and pervasive; they’ve been with us for decades, and changes to methodology haven’t had much effect in remedying them. By contrast, the Apache Software Foundation has been around for 20 years and the Apache Way – the framework of values and governance for Apache Software Foundation projects – has been the guiding force for dozens of highly successful software projects that are used in countless environments everywhere, run much of the Internet, and are probably used by every technical person in one way or another every day. In fact it would be hard to find any other software organization, open or proprietary, with a better track record. What if the Apache Way were applied to all software projects? Could the Apache Way be the answer to solve these universal software engineering challenges, for everybody, once and for all?

Baidu is one of the biggest Internet company, it was founded 20 years ago with 10,000 more engineers now.nit began to embraces open source recently years, including adopting InnerSource and contributing to open source community. InnerSource is the use of apache ways inside the company. n As the leader of this program, I will talk about how this happened, and what’s the challenges we faced and overcome. we need to set policies, define processes and enable tools , but the most important part is to cultivate open source culture, educate engineers what is apache way and how to cooperate inside company just like in open source community. And now, many projects inside Baidu have been adopting InnerSource, and some projects have became mature and open sourced to external world, even contributed to open source foundation.nWith my affords, Baidu has contributed three projects into apache software foundation as incubator projects,nthere are echarts, Doris, brpc. But open source is a long journey, we need to insist and keep going.

All podling releases need to be voted on by the incubator PMC before being released to the world. I’ll go through what the incubator PMC looks for in every release and what you can do to make it pass that IPMC vote and get your project one step closer to graduation. More importantly I’ll cover where you can get help if you need it. In this talk, I’ll describe current incubator and ASF policy, recent changes that you may not be aware of, and go into detail the legal requirements of common open source licenses and the best way to assemble your NOTICE and LICENSE files. Where possible I describe the reasons behind why things are done a certain which may not always be obvious from our documentation. I’ll show how I review a release and the simple tools I use. I’ll go through a worked example or two, including a fictional project called Apache Wombat, and cover common mistakes I’ve seen in releases.

Zhaopin.com is a Chinese online recruitment services provider. As a bilingual job board, Zhaopin.com has one of the largest selections of real-time job vacancies in China. All recruitment advertisements are provided by prominent Chinese and foreign companies and enterprises throughout China. Zhaopin.com provides professional HR services to over 2.2 million clients and its average daily page views are over 68 million.nApache Pulsar was developed to address several shortcomings of existing messaging systems including a lot of enterprise features, message durability, and lower message latency. Zhaopin.com had built its enterprise event bus By using RabbitMQ for years. As the company grows, the amount of its data is getting larger and larger, and the usage scenarios of message systems are also become varied. The original RabbitMQ based architecture was hard to afford. Ultimately, it chose Apache Pulsar to replace RabbitMQ based architecture in 2018. Since Apache Pulsar was deployed at August 2018, The data amount in Pulsar is increased from 30 million messages per day to 6 billion+ messages. By learning from a lot of practical experiences, they summarised the best practices to using Pulsar as an enterprise event bus. Penghui and Jia detail how Apache Pulsar meet the requirements from Zhaopin.com. How Apache Pulsar is used in Zhaoping.com, and What is the best practices to using Pulsar as an enterprise event bus. Along the way, they will highlight the advantages of Apache Pulsar over the old system, and how high durability, high throughput and low latency of Apache Pulsar make it ideally suited for enterprise event bus.

In our global economy, businesses must be nimble and often have to adapt quickly. As a result, many businesses structure their teams in an Agile way to keep up with this demand. With Domain Driven Design, it’s possible to quickly modify applications to accommodate changing business needs and easily integrate with disparate third-party systems. But what if you were able to use historical data and analytics to enhance your applications capabilities? You may not always have all the necessary information in your CRUD database. With Event Sourcing, you are able to store new application events as well as existing events resulting in more robust applications. This makes it possible to change your application in ways you have never imagined before! This talk will show you how you can design your Event Sourcing based application with Spring Boot and Apache Kafka.

As data continues to evolve, there are more and more requirements for calculating data. From servers to VMS to containers to serverless, the computing framework is constantly evolving with the needs of users. How to provide users with a fast, easy-to-deploy computing framework has become a question for everyone to think about. In this talk, we will introduce how Pulsar provides a powerful computing power based on the serverless computing architecture. Apache Pulsar is a new generation of cloud messaging system and real-time processing platform. The message system is closely related to the real-time computing platform, but it is often loosely deployed and managed separately. Pulsar Functions, as the computing component of Pulsar, is a fusion and innovation of the message and computing platform in the serverless direction. Pulsar Functions provides support for multiple languages such as Go, Python, and Java; and runtimes such as Thread, Process, and Kubernetes. This provides great flexibility for user-written, run, and deploy features. Let users only use logic that cares about real calculations, without complicated configuration or management; it is easier to build a message-triggered flow platform.

As applications become more reliant on real-time data, streaming/messaging platforms have become more and more popular and crucial to any data pipeline. Currently, many streaming/messaging platforms are only used to access the most recent events from streams of data, however, there is tremendous value that can be unlocked if the full history of streams can be queried in an interactive fashion. Pulsar SQL is a query layer built on top of Apache Pulsar (a next-gen messaging platform), that enables users to dynamically query all streams, old and new, stored inside of Pulsar. Thus, users can unlock insights from querying both new and historical streams of data in a single system. Pulsar SQL leverages Presto and Apache Pulsar’s unique architecture to execute queries in a highly scalable fashion regardless of the number of partitions of topics that make up the streams. In this talk, we will examine the use cases and advantages of being able to interactively query events within an streaming messagingnplatform and how Pulsar enables users to do that in the most user-friendly and efficient manner.

Apache Calcite is a data management framework that includes a SQL parser and query optimizer. It is used by many projects that implement SQL processing capabilities, including Apache Beam and Apache Flink. Over the last years, members of these three communities had many discussions about the semantics and syntax of ‘Streaming SQL’. End of last year, we decided to formalize and summarize our views and ideas in paper that we submitted to the Industrial Track of the SIGMOD 2019 conference. The paper got accepted (http://sigmod2019.org/sigmod_industry_list). It presents a three-part proposal for integrating robust streaming into SQL, namely: n(1) time-varying relations as a foundation for classical tables as well as streaming data,n(2) event time semantics, n(3) a limited set of optional keyword extensions to control the materialization of time-varying query results. The paper shows how with these minimal additions it is possible to utilize the complete suite of standard SQL semantics to perform robust stream processing and motivates and illustrate these concepts using examples and describe lessons learned from implementations in Apache Calcite, Apache Flink, and Apache Beam. In this talk, we present our ‘Syntactically Idiomatic Approach to Manage Streams and Tables’.

Apache Kafka is a de facto standard streaming data processing platform. It is widely deployed as event streaming platform. Part of Kafka is its stream processing API “Kafka Streams”. In addition, the Kafka ecosystem now offers KSQL, a declarative, SQL-like stream processing language that lets you define powerful stream-processing applications easily. What once took some moderately sophisticated Java code can now be done at the command line with a familiar and eminently approachable syntax.nThis session discusses and demos the pros and cons of Kafka Streams and KSQL to understand when to use which stream processing alternative for continuous stream processing natively on Apache Kafka infrastructures. The end of the session compares the trade-offs of Kafka Streams and KSQL to separate stream processing frameworks such as Apache Flink or Spark Streaming.

Mobile development is hard, no matter what tools you use. With thenmultitude of devices out there how can you maximize the chance to delightnyour users? Jesse has been actively contributing to hybrid mobilendevelopment projects and writing hybrid mobile apps for 10 years and willnshare his bag of tricks. Learn best practices so you can optimize yournworkflow, and develop the best possible mobile applications.