1 2 3 18

Hortonworks, Pivotal join up for Hadoop project

Hortonworks, Pivotal join up for Hadoop project

 

Competitors band together to contribute to Apache Ambari project for Hadoop provisioning, monitoring, and management

 

Follow @syegulalp

Hadoop rivals team up, give one of its underlying projects a boost

Credit: Wikimedia

When it comes to the Hadoop data platform, Hortonworks and Pivotal could scarcely have more dissimilar approaches. The former prides itself on being a non-proprietary, pure open source product; the latter touts its utility and power as an enterprise data system.

But the two can agree on one point: the value of the underlying open source projects comprising Hadoop. To that end, Hortonworks and Pivotal areplanning to collaborate on the Apache Ambariproject to contribute a component that handles provisioning, monitoring, and management within Hadoop.

Ambari gets little press compared to some of Hadoop’s other components, such as Apache Hiveor Apache Spark. But with orchestration, devops, and management taking more of a front seat in the minds of IT managers and enterprise data wranglers, a project like Ambari will likely become pivotal (please pardon the pun).

When I spoke to Shaun Connolly, vice president of corporate strategy at Hortonworks, he provided some context for why his company and Pivotal are collaborating. “Ambari has been building momentum for more than 18 months now,” he explained, “to the point where the folks at Pivotal, who have made their own operations tools, have been taking a good hard look at it and wondering if they can adopt it and invest in it.”

Out of that came a mutual decision to work with Pivotal, where the two companies will develop a joint road map for how to contribute to Ambari.

Much of what motivated the decision to work on Ambari, rather than other Hadoop projects, was what Connolly described as a picture of the broader enterprise Hadoop stack. “It’s not just the data management and data access pillars like HDFS and Yarn, and access engines like Hive, but also pillars like security and governance,” he said. “If you look first and foremost at the area of ops, though, a lot of investment need to be made there to really hit the mark for mainstream enterprise deployment. A lot of the bang for the buck from Pivotal was to choose that as a first area for collaboration.”

Connolly didn’t believe, however, that an increased focus on Ambari would mean a de-emphasis for Pivotal on its proprietary enterprise-grade offerings. “We’re looking for clean areas where we can both invest in enterprise Hadoop and jointly market to mutual customers to deploy at scale,” he said. When it came to which project seemed to afford the best value for both companies, “Ambari fit the bill.”

What makes Ambari special, especially as of its most recent releases, is how it provides ways to extend and expand upon the management framework it provides for Hadoop, says Connolly. Ambari “enabled a pluggable infrastructure where you can define external components in what Ambari calls stacks,” he explained. “It not only deploys the standard enterprise Hadoop services, but integrates any third-party component into the installation, provisioning, and monitoring process.”

This means it could serve as a connector back to products like Chef, Puppet, or Salt. “We have a lot of customers who use Ambari’s REST APIs and use Chef, Puppet, or other devops tools to provision with them.” For example, Ambari’s blueprints feature allows the layout of a Hadoop cluster to be defined, exported, and reused. “With five or six API calls, you can lay down your machine using Chef or Puppet, and make five or six REST or API calls into Ambar to provision the Hadoop infrastructure with the right order of services. It fits pretty cleanly.”

It’s all but impossible to speak of orchestration or management these days without also mentioning Docker, so I asked if one of the possible future directions for their contributions to Ambari would involve that software-containerization system. Connolly agreed that Docker “will be relevant in not only Hadoop’s space but the broader PaaS space. From a runtime perspective, it could be the substrate that helps glue the different perspectives together, whether in a data-centric view or an app runtime view. Things like operational deployment and security also belong in that domain.

“Stay tuned on the Docker front,” he added. “There’s a lot more interesting stuff to be done there.”

This story, “Hadoop rivals team up, give one of its underlying projects a boost,” was originally published at InfoWorld.com. Get the first word on what the important tech news really means with the InfoWorld Tech Watch blog. For the latest developments in business technology news, followInfoWorld.com on Twitter.

——virtual-sales-force-does-the-effort-of V131

Virtual Sales Pressure does the effort of prospecting for your sales group. Our representatives developed and confirm certified meetings with genuinely interested leads. Your sales group will certainly get where the Virtual Sales Pressure company broker ended

. Your sales individuals will have the capacity to create depend upon and connection, eventually marketing your product or service to these brand-new business contact. Conferences total or you do not spend for them:. Has your sales representative ever driven throughout neighborhood to uncover the specific runs out the work environment or likewise chaotic to abide by? It happens a lot more that you believe and when this occurs you’re losing time and money with your sales initiatives. We will certainly not charge for conferences that do not happen. We have a tried and checked method to originally pre-qualify(based on equally approved demands), established a meeting for a particular date/time, advise, verify and supply updates to your CRM. We’ll even follow-up with your representative post-meeting for comments, adhering to actions and earnings chance. Right here is a glance into our Five-Step Pre-Qualification Procedure:. Business is on an accepted listing of target business. The call is reviewed for the perfect title and/or getting authority for your services and products. The telephone call reveals receptivity to an advertising conversation to added acknowledge your offering.

The call addresses definitive script concerns

How to Grow a Business

How to Grow a Business: When Big Companies Were Small [Infographic]

 

 

Even the biggest multi-billion dollar conglomerate started off as a small business.  After studying some of the most dominant brands, it’s clear there was one common denominator that they share when growing their business — having a clear vision.

A clear vision of what you want to accomplish is one of the factors that will ultimately help grow your business from a small startup to big time player. Want to know how to grow your business? See how global brands such as Apple, Google, and Facebook did it.

Apple has brought about one of the most monumental changes with its innovative mobile devices and impeccable designs, which all started with Steve Job’s vision of allowing the individual and aesthetics to be the center of the computing universe, not the mainframe. Google toppled all search engines in the industry based on their ability to scale and make the web free for everyone. Facebook completely redefines how we connect with friends and brands and this success is attributed to their persistence in growing during pivotal points rather than selling it off.

While it is hard to recall sometimes, all these brands had their defining years of growth and they all kept to their vision.  Do you want to learn how to grow a business? Check out how these global enterprises got their starts!

Growing a business? Download our free ebook to learn more about the Top 10 features you need in a CRM.

note: click on the image to see a larger version

Online Sales Pressure does the initiative of prospecting for your sales group. Our reps established and verify certified meetings with really interested leads. Your sales team will definitely get where the Virtual Sales Stress company broker ended

. Your sales people will have the capability to create depend upon and connection, eventually marketing your service or products to these brand-new business contact. Meetings amount to or you do not invest for them:. Has your sales representative ever driven throughout neighborhood to uncover the specific runs out the office or additionally busy to adhere to? It happens much more that you believe and when this happens you’re losing time and cash money with your sales initiatives. We will absolutely not bill for conferences that do not take place. We have a tried and checked strategy to originally pre-qualify(based upon equally approved demands), developed a seminar for a particular date/time, advise, validate and supply updates to your CRM. We’ll even follow-up with your rep post-meeting for remarks, adhering to activities and profits possibility. Below is a look into our Five-Step Pre-Qualification Process:. The business is on an accepted listing of target companies. The telephone call is evaluated for the perfect title and/or acquiring authority for your products and services. The telephone call reveals receptivity to a marketing discussion to added recognize your providing.

The contact addresses definite script inquiries

——virtual-sales-force-does-the-effort-of V133

Digital Sales Force does the effort of prospecting for your sales group. Our representatives set up and confirm certified meetings with really interested leads. Your sales group will absolutely obtain where the Virtual Sales Pressure business broker left off

. Your sales individuals will have the ability to construct depend upon and connection, ultimately marketing your service or products to these brand-new business get in touches with. Conferences amount to or you do not spend for them:. Has your sales representative ever before driven throughout community to discover the individual go out the office or also frantic to comply with? It occurs a lot more that you think and when this happens you’re wasting time and cash money with your sales efforts. We will certainly not charge for seminars that do not occur. We have a tried and tested strategy to initially pre-qualify(based on equally approved demands), developed a conference for a particular date/time, advise, confirm and provide updates to your CRM. We’ll also follow-up with your representative post-meeting for comments, following activities and income possibility. Right here is a look into our Five-Step Pre-Qualification Process:. The business is on an approved listing of target manufacturers. The telephone call is examined for the ideal title and/or acquiring authority for your services and products. The call reveals receptivity to a marketing discussion to added acknowledge your providing.

The contact addresses definitive script inquiries

Online Sales Force does the initiative of prospecting for your sales group. Our reps developed and verify certified conferences with really interested leads. Your sales team will definitely get where the Virtual Sales Pressure company broker left off

. Your sales people will certainly have the ability to build rely on and connection, inevitably marketing your service or products to these brand-new business contact. Conferences total or you do not spend for them:. Has your sales representative ever driven throughout neighborhood to find the specific runs out the workplace or likewise frantic to comply with? It occurs a lot more that you believe and when this occurs you’re wasting time and cash with your sales initiatives. We will certainly not charge for seminars that do not take place. We undertake and tested technique to initially pre-qualify(based upon mutually accepted demands), set up a seminar for a specific date/time, remind, confirm and provide updates to your CRM. We’ll also follow-up with your rep post-meeting for remarks, complying with actions and earnings possibility. Below is a look into our Five-Step Pre-Qualification Procedure:. The business is on an accepted listing of target companies. The phone call is assessed for the suitable title and/or getting authority for your services and products. The telephone call discloses receptivity to an advertising talk to additional recognize your providing.

The call addresses definite script inquiries

Virtual Sales Force does the initiative of prospecting for your sales team. Our agents developed and verify certified meetings with truly interested leads. Your sales group will certainly acquire where the Virtual Sales Pressure company broker left off

. Your sales people will certainly have the capability to construct rely on and connection, inevitably marketing your service or products to these new business contact. Seminars total or you do not spend for them:. Has your sales agent ever driven throughout neighborhood to uncover the specific go out the workplace or also chaotic to abide by? It takes place much more that you think and when this happens you’re losing time and cash with your sales initiatives. We will certainly not bill for meetings that do not happen. We have a tried and examined strategy to originally pre-qualify(based upon mutually approved demands), developed a conference for a certain date/time, advise, validate and provide updates to your CRM. We’ll also follow-up with your representative post-meeting for remarks, adhering to activities and profits opportunity. Here is a glimpse into our Five-Step Pre-Qualification Process:. The business is on an approved listing of target business. The phone call is assessed for the optimal title and/or acquiring authority for your products and services. The call discloses receptivity to an advertising talk to added acknowledge your offering.

The contact addresses definitive script questions

Virtual Sales Force does the initiative of prospecting for your sales group. Our reps set up and confirm qualified meetings with genuinely interested leads. Your sales group will absolutely get where the Virtual Sales Pressure business broker left off

. Your sales people will have the capability to construct depend upon and connection, inevitably marketing your product or service to these new business call. Seminars amount to or you do not invest for them:. Has your sales agent ever driven throughout community to uncover the specific go out the office or likewise hectic to abide by? It happens much more that you believe and when this happens you’re losing time and cash with your sales initiatives. We will definitely not charge for meetings that do not happen. We have a tried and tested strategy to initially pre-qualify(based upon mutually accepted demands), set up a conference for a particular date/time, advise, verify and supply updates to your CRM. We’ll also follow-up with your rep post-meeting for remarks, following actions and profits possibility. Below is a look into our Five-Step Pre-Qualification Process:. The business is on an approved listing of target firms. The phone call is evaluated for the suitable title and/or obtaining authority for your products and services. The telephone call reveals receptivity to an advertising discussion to extra recognize your providing.

The get in touch with addresses definitive script questions

Digital Sales Pressure does the initiative of prospecting for your sales group. Our agents established and confirm certified meetings with really interested leads. Your sales team will definitely get where the Virtual Sales Pressure business broker ended

. Your sales people will have the capability to create rely on and connection, eventually marketing your product or service to these new company get in touches with. Seminars total or you do not invest for them:. Has your sales rep ever before driven throughout area to find the individual runs out the workplace or likewise busy to comply with? It happens much more that you think and when this happens you’re losing time and cash money with your sales initiatives. We will absolutely not charge for meetings that do not occur. We have a tried and checked strategy to initially pre-qualify(based upon mutually accepted demands), set up a meeting for a certain date/time, remind, verify and provide updates to your CRM. We’ll also follow-up with your representative post-meeting for remarks, following activities and earnings opportunity. Right here is a glimpse into our Five-Step Pre-Qualification Process:. Business is on an accepted listing of target companies. The phone call is reviewed for the suitable title and/or getting authority for your products and services. The call discloses receptivity to a promotional talk to additional acknowledge your offering.

The call addresses definitive script questions

Creating the Digital Brain

 

Creating the Digital Brain

 

• FEATURES • By Kaushik Das

 

featured-building-digital-brain

 

Oil spills from mining accidents can cost tens of billions per incident. The famed BP Oil spill in the Gulf cost $40 billion alone for the company, never mind the uncalculated cost of the region impacted.

How could this type of economic and environmental disaster be avoided? Our answer is smart systems. And they are not just a pipe dream, the Pivotal Data Science team has been working hard over the past few years to provide real, practical solutions to answer this type of issue for the oil and gas industry, as well as others.

The idea is to instrument the drilling rig to be a smart system. Drawing on concepts of the Internet of Things (IoT), where any machine from personal wearables, like smart phones and Fitbits, to industrial equipment like jet engines, power turbines and drilling rigs can be constructed as a system of sensors and actuators, essentially creating the the sense organs and limbs of the smart system.  Put these together with the remarkable advancements in big data technologies which enable us to pull petabytes of data into a Data Lake that we can use as a basis to employ complex machine learning models efficiently, and we have the basic two ingredients of a smart system that could monitor and prevent accidents, downtime and even ensure energy efficiency.

Digital Brain = Data Lake + Data Science

How will a smart offshore oil platform work?  Let’s look at the three elements—the sensors, the brain, and the actuators.

The sensors in a drilling rigs measure temperature, pressure, and Monitoring While Drilling (MWD) variables, which can include seismic, gamma ray and high frequency electromagnetic data, as well as hydraulic and mechanical variables.  To create the digital brain, we load all of this data along with measurements made off the drill like those of drilling fluid properties and previous seismic data into a Data Lake.  Here, the all the data is stored together and we can extract patterns in the data.  Since the data for one oilfield involving multiple boreholes can run into hundreds of variables and billions of rows we use a parallel modeling package like MADlib to extract patterns from the data in an efficient manner.  This involves clustering the data and then regressing over the rate of penetration of the drill.

Once we have a good model, we can operationalize it by checking the actual rate against the predicted rate.  If the predicted rate is different, we flag it as an anomaly.  We also create a library of anomalies and label them.  Armed with that dataset, we are in a position to monitor the drilling and take appropriate action if we detect an anomaly.  For instance, if the anomaly is associated with a blowout, we can set the brain to stop drilling by activating the actuators (the control system) and send a red alert to the control room to initiate a response team to investigate.  They may find that this anomaly is just be an indication that the drill bit is wearing out earlier than anticipated and needs to be changed.  Or, importantly, they may discover a serious threat and be able to stop a catastrophe like the BP oil spill.

In the case of the former, this has an added bonus of helping us to do predictive maintenance, and improve the productivity of our operations.  It is an example of the application of Data Science methodology on the appropriate technology.

The Technology Behind the Science

Here at Pivotal we have been making great strides in building the platform that houses the Data Lake.  This includes a parallel storage system based on HDFS with parallel database (namely, HAWQ andGreenplum) and in-memory (Gemfire) modules with a variety of other components that make it easy to ingest and store data, compute on it, and take action.  The whole platform is based on open standards, which makes it highly compatible with a lot of third-party software and effectively future-proofs it.

Centralized_Management

Other Applications for the Digital Brain

Another example of making a system smart would be putting a digital brain into a smart grid.  Right now we have smart meters collecting an enormous amount of data regarding power usage from every business and household.  This maps the entire range of activity in any city!  But how do we get value from that?

The answer is once again to load this data into a Data Lake and look at the frequency content of the time series signals we get from every smart meter.  This enables us to cluster every meter and find out outliers or anomalies.  Then again, as the system tracks the changing of the behavior of a cluster or even individual smart meters, we can identify anomalies as they happen. Over time, we can train our model and label these anomalies as meter malfunctions, meter tampering or vegetation management (a tree or a branch falling on a power line).  Now we have created a Smart Grid than can be our eyes and ears everywhere across the power grid, and can take the appropriate action to prevent downtime and at the same time achieve optimal performance.

Download the Pivotal Data Science Lab datasheet.

The possibilities of the digital brain to transform industry are manifold. We are working steadily to apply this methodology widely, including another industry we are talking about this week at Strata—smart cities and the connected car .

The true potential of the IoT will be realized when we are able to create digital brains and transform the IOT from just things to a self-aware systems.  This will never eliminate the human element, rather it will make human intervention more effective and reduce delays and scope of error in action.

Jeff Immelt of GE has said that “zero unplanned downtime” is a key goal for GE’s use of the Industrial Internet.  But we can take this even further—what about zero unplanned outages, zero industrial accidents and zero environmental disasters?

The opportunity is right here, let us all make it happen!

 

http://brontobytes.info

1 2 3 18