Loading...
HomeMy WebLinkAboutLicensing Agreement - Aunalytics Inc - Enterprise Data Management and Analytics Platform1316 COUNTY—Cuy BUILDING 227 W.JEFFERSON BOULEVARD SOUTH BEND_ INDIANA 46601-1 930 to U; 1865 CITY OF SOUTH BEND PETE BUTTIGIEG, MAYOR BOARD OF PUBLICWORKS February 12, 2019 Taylor Oake Aunalytics, Inc. Catalyst One at Ignition Park 460 Stull Street, Suite 100 South Bend, IN 46601 RE: Licensing Agreement Dear Mr. Oake: PHONE 574/235-9251 FAx 574/235-9171 The Board of Public Works, at its meeting held on February 12, 2019, approved the above referenced agreement for enterprise data management and analytics platform in the amount of $151,160, for a two (2) year agreement. Enclosed please find the original of the agreement for your signature. Please sign and return the original agreement to our office and retain a copy for your records. If you have any further questions regarding this matter, please call this office at (574) 235- 9251. Sincerely, Linda M. Martin, Clerk Enclosure GARY A. GILOT SUZANNA M. FRiTZBERG ELIZABETH A. MARADIK LAURA O'SULLIVAN THERESE J. DORAU P", pry A u, na t i cS +r4vamk chat; o Enterprise Data Management & Analytics Platform January 2019 Prepared for: City of South Bend 11R, CVO . 10,l2 WY,°s.J 14_u6: P4 1 Al, ExecutiveSummary........................................................................„„....„„....„„......„......„........... 3 PartnershipOverview.............................................................. ,...„„....... .„.„..,........................ 3 ProposedSolution....................................................................„,.....„..„..,„........„...............a...4 Pricingand Payment Terms.........„.„.......„ .. ...... ................................. .„.„...,„..„„.....„..,.......... —. 6 Miscellaneous Terms and Conditions .................................... ....... ....... ..„..„..„....................... Appendix A: Responsibilities and Process ..... ......... ..... „..„...... „..„ „ „. ,,,..,................ „.„„.„ 9 Appendix B: Aunsight Cloud Analytics Platform.......„.....„..„„.„.„.„.....„„.„..„„....„......................10 Appendix C: Self -Service Training Curriculum ......... ........ „„„„„..„........ ..................... .„..„„....... 17 2 Aun ly I s Executive Summary Partnership Overview The City of South Bend's Department of Innovation and Technology ("the City") has reached a level of maturity that necessitates a more sustainable and user-friendly method of storing and accessing data for regular, automated reporting and data workflows. Likewise, as data becomes more accessible to a greater number of employees and the sources of data within the City continue to grow and evolve, documenting policies and procedures for data governance will become increasingly important. As a result, over the next six months, the City of South Bend will look to improve their enterprise data management capabilities. Current Challenge: The scale and complexity of data has outpaced the City's existing infrastructure, which makes it difficult to provide proactive, timely, actionable information/insights to analysts and business decision -makers. The existing system was not designed to scale and enable more advanced, big data analytics initiatives and manual processes have resulted in a drain on the City's skilled technical resources. Additionally, it's been acknowledged that certain aspects of data quality, data governance, and business/reporting assumptions within each of the disparate legacy systems are not always uniform and aligned. Objectives Establish Data Management Infrastructure — Collaborate with a professional services partner to design, implement, and learn how to maintain an appropriate data management architecture for the City of South Bend. Requirements: • The architecture will facilitate easy access to reporting tables for semi -technical end -users (ie, Business Analysts) • The platform will allow the City to query and combine data across multiple enterprise sources and without impacting the performance of transactional databases • The data management solution will serve as "single source of truth" by providing transformed and joined tables, clear field names, and structuring metadata for each source 3 yLICS r 0 rir,Ik1 • The platform will facilitate the building and deployment of automated workflows, such as BI dashboards and seamlessly update the City's Open Data Portal • The implemented solutions can be built upon and scaled to support more advanced analytics and machine -learning processes • The City of South Bend will be able to maintain the solution and add new data sources as their Applications landscape grows and evolves Proposed Solution Cloud Analytics Platform (Aunsight) Aunalytics is proposing a formal data management and analytics partnership that will assist the City in the maturation of their big data management and advanced analytics capabilities. This proposal provides the design and pricing for establishing and maintaining the City's Cloud Analytics Platform. Aunalytics will design, build, and implement the cloud analytics platform, including all necessary hardware, software, security, ongoing management, and support (as necessary) to meet the City's current and future data management and analytical requirements. The implementation consists of the following hardware, software, and service components: • Data Gateway (virtual APIs) connection and management for aggregation/acquisition of at least two supported API's for cloud sources of client data. • Workflow Manager licenses for data and platform resource management and orchestration. • Dataflow Manager is an automated process managing the transformation of raw data into high -value data sets. • Accelerated Data Access layer setup and management for up to ten (10) named users for optimal, fast interaction data residing on the platform. • Set up and management of all Network, Storage, Compute and Security Infrastructure (as -a -service) required to meet the City's goals. • A deeper description of the platform components and managed services is included as Appendix B of this document 4 A(. nall [ytic , f b", Milestones & Deliverables Aunalytics estimates 6-8 weeks, from the time of signature, in order to fully -implement the Cloud Analytics Platform (Aunsight). Many of the following items could be completed in parallel. The platform itself only takes a few days to set-up (ready to ingest data). Milestone 2 — connectivity and acquisition of client data generally takes the longest, as it's more heavily dependent on collaboration with client resources. Milestone 1: Aunsight Compute Cluster has been setup and tested with results displayed to City. (—I week) Milestone 2: Connectivity established securely between Data Gateway(s) and Cloud Analytics Platform, demonstrating readiness to ingest the City's data. (-1-2 weeks) Milestone 3: Ingestion from the City's data sources established and streaming daily with Accelerated Data Access Layer provisioned and tested. (-1-2) Milestone 4: Security layer provisioned and the City's user access has been set-up. (-1 week) Milestone 5: Host initial training sessions for Accelerated Data Access Layer & Self -Service Aunsight users. (-1 week) 5 yics „IIIt1 VN€ ;4,6Y Y w Aunsight - Cloud Analytics Platform (2-Year Contract) One -Time Fees Infrastructure Setup Price build, Implementation .._._ _......... _ .._ ....._.. Platform design, .... Integrate & stage data for access by City of SB personnel Total One-time Fees $20,000 Managed Infrastructure Price Analysis Computing Node (4 Cores) Storage Node (3TB Raw Storage) Acceleration Data Access Layer (via any ODBC connector - 2 users) Data Gateway Management (automated data aggregation/ingestion) 10% Discounted Rate $1,778 ..........._w........ ... vW. Software Price Aunsight Server License (Workflow, Data Flow, Data Science Lab - 4 cores) Aunsight - Self -Service User License (Up to 5 users) 10% Discounted Rate $3,420 Managed Services Price Support / Training (1 half -day training session per quarter) $267 Total Monthly -Recurring $5,465 Platform Scalability The platform can scale as -needed in a variety of ways. Additional storage and/or compute nodes will be added, as data sources and processing requirements grow. If additional platform components are required, Aunalytics will communicate this ahead of time to the City. Item Recurring Trigger cost/month Infrastructure 1. Analysis Compute node (2 Cores / 40 $250 GB RAM) 2. Analysis Storage Node (per TB) $200 3. Accelerated Data Access Node $100 4. Each additional data source outside of $150 data gateway (powered by Aunsight) Aunsight Software 5. Aunsight Server License (unlimited $1,500 Workflows and Dataflows) 6. Aunsight User License $400 8. Sightglass Mobile Platform per user $ 50 Managed Services 9. Use Case Support Subscription $2 000 $8,000 Dependent on workload and time requirements Raw data size + processing space + historical retention Per named user Each external source (API)* Per 2 additional Core 1 per named user Blocks of 10 named users per month . per use case depends on complexity Standard Professional Services Rates ... ....-..---- --- .w ..... ............. _ Required Skill Set Cost per hour 1 C Level / Senior Data Scientist $300 2 Data Scientist $250 3 Data Engineer / Programmer $200 4 Business Analyst $200 --- ....w-.-- *Professional services rates would apply to pre -approved items outside the scope of this proposal ..... 7 '�! MiscellaneousTerms and Conditions Terms If this proposal is accepted it will convert to a Statement of Work (SOW) with a Master Services Agreement (MSA). One Time fees will be billed upon execution of this proposal. Monthly recurring fees for the platform infrastructure, software, and support/training will begin the month that the data management and analytics platform is set up and ready to ingest data. Quote Expiration This quote expires 30 days from today's date, at which point the pricing and implementation timeline will need to be reevaluated. Authorization IN WITNESS WHEREOF, the parties agree to the services, pricing, and timeline described in this Proposal, and at the date of signing have the necessary and appropriate authority to bind his or her respective organization hereunder. City of South Bend Aunalytics, Inc. By: AV w Print: "ard OfPIS µr VarkA By: Print: Its: Date: 8Aunalyks Umd.;,U City of South Bend Responsibilities 1. Assign a Project Manager who: a) Is available to Aunalytics personnel throughout the life of the project; b) Will coordinate all interviews and meeting schedules for the City's team; and c) Is authorized to accept the weekly status reports and approve changes. 2. Assign managers and other personnel, as appropriate, to work with Aunalytics throughout the project duration. The City shall make a knowledgeable representative available to Aunalytics during all phases of the engagement and will engage and participate throughout the project duration. 3. Work with Aunalytics to procure all hardware, software, and licenses necessary for Aunalytics to provide the proposed services. 4. Review status or acceptance reports and provide acceptance or feedback within three (3) business days of receiving status reports. 5. Work with Aunalytics to ensure that necessary references, access, documentation, feedback, and acceptance are provided to progress towards success. Aunalytics Responsibilities 1. Provide any relevant documentation related to this project in Microsoft Word and/or PDF format. 2. Provide a single point of contact to the City for the duration of the project for coordination and scheduling of project tasks, documentation and any changes to scope requiring a Change Order. 3. Coordinate activities of all Aunalytics resources and provide consultants with the requisite skills necessary to properly execute the requirements of this Proposal. 4. Communicate status and changes to The City before and during the engagement. 9 Aunalytics 1 i& INTERNAL DATA CLOUD DATA 1� %' o% IOT DATA ,Q, WEB APP MOBILE APP h CUSTOM DATASETS SERVICES & FEATURES BRIEF DESCRIPTION Workflow Manager Unique software automating processes managing the entire flow of data analytics from infrastructure to insights. I nfrastructu re -a s-a -Service Networking Infrastructure, Storage Infrastructure, Computing Infrastructure & Security Infrastructure Data Gateway & Ingestion Physical (Device) & Virtual (API) Data Gateways with user Node portal. Dataflow Manager Unique software automating processes managing the transformation of raw data into high -value data sets. Accelerated Data Access Node Layer providing City's technical team access to new, analytics-ready data sets. Who k 1 Workflow Manager A key component of the Cloud Analytics Platform is its ability to manage the various components of the platform to perform complex data management and analytical tasks. The Workflow Manager license provides a mechanism to automate the entire end -to -end solution of data aggregation, and delivery through the development of workflows that can be event -driven or executed according to a defined schedule. Aunsight's Workflow Manager provides capability above and beyond the simple management and execution of data processing tasks. Such capabilities include the ability to embed data and processing quality assurance processes, dynamic allocation and configuration of available computing environments, as well as event and process monitoring and alerting. These features are designed to provide transparent processing pipelines, which allow proactive responses to technical issues and the ability to leverage the optimal mix of technologies in delivering insight in a timely manner. The Workflow Manager controls permissions set for the City's team members allowing different levels of data access. The Workflow Manager license scales appropriately with the Data Ingestion, Storage, Analysis Computing, and Accelerated Data Access nodes as defined in the pricing and payment terms. Infrastructure -as -a -service The Networking Infrastructure within the Aunsight Platform relies on a robust and excellent level of performance to ensure efficient and secure data management and analytics processes. The networking infrastructure is configured to limit visibility and access to the resources available within the network and comes with both human and machine monitoring services to ensure reliability. The networking infrastructure to be provided consists of the following hardware and service components: • A regulatory compliant physical firewall device with an intrusion detection system (IDS) • 10 Mbps internet access • Redundant 10Gbs switching infrastructure • Managed visibility and access • Periodic traffic analysis and real-time network component monitoring and alerting. t Prfs r IBA The Storage Infrastructure within the Aunsight Platform uses the most appropriate storage for the analytics solution being delivered. The Aunsight Platform is engineered to be storage - agnostic, working seamlessly across the best storage component to serve the City's needs. Common storage components include Hadoop (HDFS) distributed redundant file storage and scalable enterprise block storage. Regardless of the storage technology selected, it is used to capture inbound data originating from either cloud -based, or client -managed sources, provide transient persistence to computational processes, and host solution -based, resultant data sets. All storage infrastructure provided is redundant, fault tolerant, and encrypts data at rest to the FIPS 140-2 standard using validated cryptographic hardware designed to meet procurement requirements for the U.S. government and various industries, including healthcare and financial services, where these features are critical to compliance policies and procedures. The storage infrastructure to be provided consists of the following hardware and service components: • 3 TB of Enterprise Block Storage (EBS) (FIPS 140-2 applies to any product that might store or transmit sensitive data. This includes hardware products like network link encryption, hard disks, flash drives or other removable storage media, as well as software products that encrypt data during transit or while stored.) The Computing Infrastructure within the Aunsight Platform executes work related to the movement, manipulation and validation of data. The processes responsible for this work are implemented and managed using container -based computing technology with benefits including elastic scalability, dynamic and compatible computing environments, fault tolerance, high availability, speed, and security. The compute infrastructure to be provided consists of the following hardware and service components: r One Computing Node consisting of 4 processing cores and 40 Gb RAM • Managed container registry • Managed environment creation and administration The Security Infrastructure within and supporting the Aunsight Platform provides the highest - level secure environment. The Cloud Analytics Platform is compliant with PCI DSS (2.0) for physical security and infrastructure availability, and maintains appropriate compliance with HIPAA and HITECH standards. The data center where the Aunsight Platform "lives" is a Tier III 12 yic i, secure data center, staffed 24x7x365 and is SSAE-16 certified. The fully redundant environment offers N+1 or 2N core systems. Data Gateway & Ingestion Node The Cloud Analytics Platform supports data ingestion via our unique, physical device and virtual APIs, Data Gateways and provides a user portal where the City can monitor data streams. The physical device transfers and ingests flat file exports from within the City's network, and the Data Gateway API's ingest data from online sources. The Data Gateway user portal puts control of the information flow into the hands of the client and is 100% managed from the client side. Data streams (sources) can be created, updated, modified, started and stopped from the gateway. After data is transferred, the Data Gateway closes the connection until the next client scheduled event. Aunalytics provides ongoing support and training on the Data Gateway as part of any engagement. The physical Data Gateway device is a secure data aggregation appliance developed by Aunalytics specifically for the Aunsight Platform. It is configured to operate within the client network to facilitate and automate the transfer of client data from its core sources to the cloud analytics platform. This device is designed to reduce the effort needed by client staff to continually update data and deliverables in a secure, configurable, and manageable fashion. The Data Gateway device seamlessly integrates with a client's existing infrastructure and creates a secure tunnel providing a FIPS 140-2 compliant, AES256 encrypted and compressed connection between client internal networks and the Cloud Analytics platform. The device also provides a secure "return path" for delivery of resultant datasets if desired. The virtual Data Gateways leverage API's to stream cloud sources, and use direct interaction to stream IoT and IIoT data broker services. Each API is secure and uses the highest level of encryption technology in -transit and at -rest. Currently supported API's include: CSV; SQL; PSV; Oracle; Excel; Google Analytics; Google Big Query; Salesforce; Pardot; cloud APIs; Google Cloud API; AdWords; DoubleClick; BidManager; DoubleClick Search; Double Click Campaign Manager; MySQL; Postgres; SFTP; Hadoop clusters; Box; Dropbox; Google Drive; AWS-Storage; IoT data from MATT message brokers (such as IBM IoT Broker). Any API needs outside those currently supported may require one-time development fees in addition to the monthly recurring. 13 Aunalyti,cs Dataflow Manager The Aunsight Platform's unique Dataflow Manager manages the process of transforming raw source data into a meaningful, high -value data set (a Data Flow). The Dataflow Manager was engineered to design and describe these transformation processes in a technology -agnostic manner. This allows the Dataflow to be translated in real-time to a specific technology that is appropriate to perform the computational transformation. Additionally, the Dataflow Manager ensures that the process used to create a high -value data set is documented, repeatable and scalable while allowing the underlying technologies to advance as new analysis tools and techniques emerge. Accelerated Data Access Node The purpose of the Accelerated Data Access layer is to provide analysts/data base administrators (DBAs) and data consumers the ability to query large datasets with minimal latency or query execution time. This dramatically enhances the experience/usage of BI tools such as Tableau, especially when working with large datasets. Experience has shown that serving end -user BI tools directly from non -accelerated database resources does not create a practical user experience. For this reason, databases are relied upon for its intended and designed purpose. The Aunsight Platform then provides Accelerated Data Access that delivers preliminary or resultant data sets to the intended user base (client DBA or Consumers), in an efficient way to create a positive and real time user experience. The Accelerated Data Access Node is a combination of hardware and software that created a columnar data structure that allows for rapid interaction and superior experience from the data consumer. The Accelerated Data Access Node is sold in blocks of ten (10) named users. 14 Au na 1. t i c s Aunsight Self Service (Dataflow, Workflow Manager & Data Science Lab) In order to deliver scalable analytics solutions to City, the Dataflow Manager, Workflow Manager, and Data Science Lab software components of the platform are required. These tools are utilized to assist in the development, implementation, and automated delivery of each solution to City. These tools through Aunsight Self -Service are open for the City's team to have access to exiting datasets and various data sources that can be used to create automated workflows by your own teams. This self-service tool gives ultimate access to your data like never seen before that will be leveraged by your teams to expand use cases or create new uses all using the same tools our data scientists use. Sightglass — Mobile Insights Platform Sightglass is Aunalytics' mobile insights delivery platform. Customers can download the Sightglass app from the App Store on either their i0S or Android smart devices (phones, tables, etc.). The ability to deliver actionable information and insights directly to a mobile device is a true game changer in today's fast -paced work environments. Executives and other highly -tasked stakeholders within organizations often don't have time to open their computer and login to a web browser, all while trying to perform their daily business functions and responsibilities. Combing through busy reports for the insights is not a plausible or actionable solution when needing to make on -the -fly, impactful decisions. The mobile platform, Sightglass, provides an analytics experience that conveniently fits into busy, everyday lives. Executives enjoy waking up each morning and to see the health of their business at a glance. Managers enjoy quickly pinpointing outliers and taking quick, targeted action on the most critical items at the touch of a finger. Sightglass gives users the flexibility to perform self-discovery and answer several questions for those that still require and wish for that ability. And, for those that just want to act, Sightglass can be configured to deliver data -driven push notifications, much like the standard text messages and alerts currently delivered on mobile devices. These notifications and alerts are configured based on your unique business parameters. Ongoing System Management Aunalytics will be responsible for the following ongoing monthly tasks related to the Platform: Aggregation Tasks: • Maintenance and validation of inbound data Service to ensure that variations in source and available outputs can be added or updated in timely fashion Data Gateway support and configuration assistance at each current/future data source • Monitor Integrity and timeliness of incoming and outgoing data feeds Workflow Manager Tasks: • Execution of workflows to manage the process of movement, transformation and delivery of data and insights • Automated alerting and quality assurance on workflows • Computing and storage management • Authentication and authorization management Security & Compliance Tasks: • Add & remove users • Add & remove groups • Maintain and manage security of client data and infrastructure • Control, monitor, and maintain firewall security • Monitor and notify client of any potential intrusion attempts • Manage system authentication • Validate all Aunsight processes for compliance • Annual third -party penetration testing • Quarterly third -party vulnerability testing • Manage data center access • SOC 2 Audit of Cloud Analytics Platform Data Set Tasks: • Manage automated connections and security from data sources • Maintain / update specific data set generation • Quality and assurance of data set integrity and delivery Colocation Tasks: • Manage fully redundant power infrastructure • Manage fully redundant cooling infrastructure • 24x7x365 physical monitoring • SOC 1 & SOC 2 audits of data center 16 Aunalyfics Appendix C.- Self -Service Training Curriculum Platform 101 1 Understanding core infrastructure components and technologies. Storage Systems 101 1 S101 Available storage systems and backends; backend data movement orchestration,. DataFlow 101 1 DF101 Replication of beginner through intermediate SQL queries in DataFlows as well as scripting commands. Advanced DataFlowl DF201 Perform advanced SQL and scripting commands in SQL, utilization of "meta" features such as parameters. Workflow 101 1 WF101 Orchestration of DataFlows, Processes, Dataset copies, and notifications within Automated process. Advanced Workflow — General I WF201 Utilization of advanced workflow features —calls to other workflows, usage of Multi functionality, etc. Advanced Workflow — QA/DW I WF202 Utilization of QA statistics and collecting metadata around task execution. Conditionally data publication strategy. Advanced Workflow — Incremental Processing I WF203 Design patterns for performing atomic work on batches of data and aggregation for master datasets. Solution Design 101 1 S L101 Overview of solution features available in Aunsight, identifies core available solution recipes as well as areas for "one-off' expansions and future core feature development. Advanced Solution Design — Exploration & Scoping I SOL201 Management and executive guide for best practices for solution requirements gathering process. Jethro 101 1 JET101 Overview of Jethro (Accelerator). Will understand key features and limitations. Tableau 101 1 TA 11 Overview of Tableau interaction with accelerator for data consumption along with key best practices. SightGlass 101 1 SG101 Introduction to core mobile delivery framework within Aunsight. DSLab 101 I DS101 Introduction to primary data science environment within Aunsight. Will be able to use statistical scripting languages (R, Python) to perform machine learning, visualization, and analysis on Aunsight-ingested datasets. Advanced IDS Lab — NLP I DS201 Introduction to core Natural Language Processing patterns and technologies within DS Lab environment. Advanced IDS Lab — Time Series I DS22 Introduction to core Time Series patterns and technologies available within DSLab environment. Advanced IDS Lab — Sequences I DS20 Introduction to core Sequences patterns and technologies (i.e. TensorFlow, Keras) available within DSLab environment. Advanced IDS Lab — Images I DS204 Introduction to core Image Process patterns and technologies (i.e. TensorFlow, Keras) available within DSLab environment. Advanced IDS Lab — Complex Networks I DS205 Introduction to core Complex Networks patterns and technologies available within DSLab environment. 19 ly iI ' s BOARD OF PUBLIC WORKS AGENDA ITEM REVIEW REQUEST FORM Date 2/4/2019 Controller Controller review is required for all Contracts $5,000.00 or more and greater than one year in length per the City Purchasing Policy Purchasing Check the A Agreement ® Professional Services [J Bid Opening El Quote Opening (1 Chg Order No. El Ease./Encroach. F Other: Company or Vendor Name New Vendor MBE/WBE Contractor Project Name Project Number Funding Source Account No. Amount Terms of Contract Purpose/Description Amount of E] El Previous Amount Current Percent of Change: New Amount Total Percent of Change Time Extension: )ro riate Item Typp7 ❑ Contract ❑ Amendment El Bid Award R Quote Award El C/O & PCA No. R Traffic Control 'for All Submissions Proposal ❑ Req. to Advertise uired Information ❑ PCA Resolution If-1 Claim Addendum ❑ Title Sheet Aunal ics Yes ® If Yes, Approved by Purchasing No �j MBE Completed E-Verify Form Attached El Yes WBE ® No Enterprise Data Management & Analytics Platform N/A - ---- ._............. Innovation & Technology 279-0672-415-31-06 and 279-0672-415-36-04 $151,160 (Total over two years ...... ............... Net 30, Two-year agreement Licensing for enterprise data management and analytics solution which will enable more advanced and real-time data analytics in the City and support accessing and combining disparate data sources. Agreement includes professional services for implementation, training, and on ping support. For Change Orders Only incre ase $ Decrease_. $ �.... ... __ .......................... ......._.............. Dispersal After Approval Copy Original