GemFire XD 1.4 Now Available for Download

Cross posted from The Pivotal POV Blog…

GemXD

The latest release of GemFire XD, version 1.4 is now available for download. its biggest improvements include single hop inserts for 50% faster performance, and support for JSON document objects in SQL tables. This makes GemFire XD even better for write-intensive use cases, such as high-speed ingest. Also, now we can support use cases that need more schema flexibility to the otherwise well-defined relational structure of GemFire XD.

[Read more…]

10 Amazing Things to Do With a Hadoop-Based Data Lake

Cross posted from The Pivotal POV Blog.

The following is a summary of a talk I gave at Strata NY that is proving popular among a lot of people who are still trying to understand use cases for Apache Hadoop® and big data.  In this talk, I introduce the concept of a Big Data Lake, which utilizes Apache Hadoop® as storage, and powerful open source and Pivotal technologies. Here are 10 amazing things companies can do with such a big data lake, ordered according to increasing impact on the business.

1

[Read more…]

TEDx Talk: “What’s the Big Deal about Big Data for Humans?”

I gave this TEDx talk to a general audience of folks at the SJSU TEDx event. It’s an interesting job trying to explain fairly complex technical concepts to a mixed audience of people of many different ages and backgrounds. It helps one realize just how much we depend on a common vocabulary and understanding in the IT industry.

And in the tradition of many TED talks, the point is to motivate an action, not just educate.

How do you think I did?

And here are the slides…

Announcing the New Version of GemFire XD and SQLFire: Pivotal GemFire XD 1.3

Cross posted from my blog at Pivotal POV…

 

 

The newest versions of SQLFire and GemFire XD are one and the same: Pivotal GemFire XD version 1.3. What were previously two separate products are now merged, so current licensees of either product are entitled to upgrade to the new version.

[Read more…]

What’s New in Pivotal GemFire 8

Reposted from Pivotal POV….

featured-gemfire-8

On September 23, 2014 Pivotal announced the release of Pivotal GemFire 8, part of Pivotal Big Data Suite. This is the first major release of GemFire since it became part of the Pivotal portfolio.

Born from the experience of working with over 3000 of the largest in-memory data grid projects out there, including China Railways, GIRE, and Southwest Airlines, and  we’ve invested more into the needs of the most demanding enterprises: more scale, more resilience, and more developer APIs.

This release is a significant enhancement for developers looking to take their big data NoSQL apps to massive scale. For the complete technical details, you can check out the new datasheet, and official product documentation.

Here’s what’s new, sorted by the 5 areas that GemFire does best in the industry:

Providing Scale Out Performance

This is why most of Pivotal’s customers begin looking at GemFire in the first place—because they can’t make traditional RDBMS’s scale with the number of concurrent transactions and data they need to manage.

Pivotal GemFire manages data in-memory distributed across multiple systems on commodity hardware—100’s of nodes if you like—in a shared-nothing architecture.  So there’s plenty of compute and memory to host all your data to get real-time response.

WHAT’S NEW

We’ve added in-memory compression, effectively giving each node the capacity to hold up to 50% more data. Compression is achieved through Snappy, a speed-optimized algorithm, although the compression codec is replaceable to whatever algorithm you want to use.

Maintaining Consistent Database Operations Across Globally Distributed Nodes

[Read more…]

Our Customers at Pivotal Recognize the Importance of Bridging Traditional Data Warehousing into Next Generation Platform

Cross posted from my blog at Pivotal POV:

Recently Gartner published the report, “Gartner Critical Capabilities for Data Warehouse Database Management Systems” that shares survey results of customers from a variety of Data Warehouse solution vendors.  The report ranks vendors in 4 categories of use cases in the Data Warehouse market: “Traditional Data Warehouse”, “Operational Data Warehouse”, “Logical Data Warehouse”, and “Context Independent Data Warehouse.”

Based on existing customer implementations and their experiences with data warehouse DBMS products, the report scored Pivotal in the top 2 out of 16 vendors in two use cases: “Traditional Data Warehouse” and “Logical Data Warehouse”.  In a third use case, “Context Independent Data Warehouse”, Pivotal scored in the top 3 relative to the 15 other vendors.

In the report, Gartner writes “the adoption rate for modern use cases (such as the logical data warehouse and the context independent warehouse) is increasing year over year by more than 50%—but the net percentage for the context independent and logical data warehouse combined remains below 8% of the total market.”

Modern Data Warehouse Use Cases Generate Trillions in Value

Many of Pivotal’s big data analytics customers started out as Greenplum Databasecustomers. These customers are both well established in traditional data warehousing techniques and take advantage of modern data warehousing scenarios supported by Greenplum Database’s advanced analytics capabilities, and other products of Pivotal Big Data Suite: Pivotal HAWQ and Pivotal HD.

Industry leaders like General Electric are using Pivotal Big Data Suite to create new solutions that cut weeks of analysis time that would be required using traditional data warehouse approaches. For example, a process for refining insightful analytics from sensor data streams generated by industrial machinery was compressed from 30 daysto just 20 minutes.

Other companies are using these approaches to improve customer retention, target advertising, detect anomalies, improve asset utilization and more. The combined potential benefit of these opportunities is staggering. GE alone predicts its solutions will boost GDP by $10-15 trillion in the next 20 years by saving labor costs and improving energy efficiency. [Read more…]

What Does “Data-Driven Company” Mean for a Developer?

data_driven

At Pivotal Software, we frequently pitch about a virtuous cycle of of data-driven app development where:

  1. A cache of data is collected and stored.
  2. A team of analysts or data scientists discovers an insight or optimization opportunity
  3. This affects the app development which generates more data.
  4. The company continues through the cycle more and more agilely.

Wash. Rinse. Repeat.

However, the story above is more of an analytics story than a developer story.  This became clear to me while sitting with some crack developers at dinner at the Spring One 2GX conference.

One of my table mates asked me, “I understand what Pivotal is saying about the virtuous cycle, but what exactly happens between analytics and apps stages?”

[Read more…]

Why I Joined Pivotal Software

Cross-posted from my first blog published on LinkedIn

On brand with Pivotal Software...

Not only did I recently join Pivotal Software, I found my way into the swag closet…

I’m proud to announce that I have joined the marketing team at Pivotal Software.

There’s a special kind of excitement in helping build a business that you know can change the world. I’m excited to have a chance to work with the many talented people here at Pivotal, and be part of an amazing company and culture dedicated to helping customers create new innovations in big data.

[Read more…]

Clamoring for Innovation Ideas Using SAP HANA at HANA 2014

Cross posted at the blog at SAPHANA.com…

As I leave the HANA 2014 conference in Orlando this week, I am simply impressed with the enthusiasm I felt from a room full of enterprise architects looking for ways to support innovation for their companies with SAP HANA.

When I was asked to present at SAP Insider’s HANA 2014 Conference in Orlando about business innovation as it relates to SAP HANA, one of my favorite topics, I jumped at the opportunity.  I was pleasantly surprised to find a room full of eager attendees waiting for me at my 8:30AM session this morning.

I always start by asking a few questions to get to know my audience. At HANA 2014 for both my sessions the audience responded as follows to my unscientific poll:

  •          50% work for SAP customers
  •          50% are consultants serving SAP customers
  •          25% are working for customers that already have or are actively considering  purchasing SAP HANA
  •          Less than 25% were business analysts concerned with software requirements
  •          75% said they are Enterprise Architects
  •          A smattering, around 5%, said they are developers

As I said, the poll was unscientific and audience members did answer multiple times in the poll choices.

You can get an idea of the perspective and interest of the people attending a session about building innovative custom applications on SAP HANA. They were not developers, but they were very interested in hearing about how they could support developers in creating innovative applications on SAP HANA.

While it’s not my intention to recreate my session in blog form, I have some interesting takeaways for myself as a result of interactions with the attendees in my sessions.  Check out the slides of my presentation on  Slideshare.

 

1.  When it comes to fostering a “culture of invention” 90% of my attendees companies appear not to partake in more forward looking approaches such as holding company Hackathons or cross functional innovation days with employees. Nor do many of them partake in crowd sourcing programs such as Kaggle, or check out SAP’s crowd sourcing program for SAP HANA customers: SAP Idea Incubator.

2.  Audience members appreciated my “3 Questions to know if you have a SAP HANA Application” slide. Many of their questions were related to geospatial data capabilities of SAP HANA and predictive analytics functionality.

 

  three_questions

[SOURCE: © SAP, used with permission] Three questions for determining if your custom application might be suitable for developing on SAP HANA.

[Read more…]

Six Enterprise IT Buzzword Predictions for 2014

bee
What new buzzwords will enterprise software marketers be adopting in 2014 to pollinate awareness and help our companies make honey?
[PHOTO SOURCE]  Used according to Creative Commons License.

Just for fun, I thought I’d share some predictions on the 2014 fate of popular 2013 buzzwords. [Read more…]