Have overall QA responsibility for the entire Vidyo.io cloud platform, both client side VidyoConnector APIs as well as testing of the back end cloud infrastructure
Managed QA release process for all Vidyo.io releases since its inception (70+ releases of the client, 43+ infrastructure releases). Worked with operations to deploy these releases to staging and production cloud environments
Managed both onsite and offsite QA engineers who perform a mix of automated and manual testing on all supported Vidyo.io clients and Vidyo.io infrastructure
Lead test effort for Vidyo.io’s WebRTC client library (Javascript library for web browsers), which included working with a consulting firm that produced a native WebRTC implementation of our existing libraries. Validated that the new library was 100% API compatible with our existing transcoded WebRTC library
Performed integration work to ensure test framework could test all supported browser based platforms (WebRTC transcoding, WebRTC native, NPAPI plugins)
Managed the development of adding additional language binding targets to the VidyoClient test framework, adding Java (Android), Objective-C (iOS), C# (Windows)
Managed the development of a real time monitoring and data visualization tool. This collected both system metrics (CPU utilization, memory utilization, etc), as well as Vidyo specific metrics (which translate to call quality). Utilized this tool to determine both where quality begins to degrade and the breaking point of each infrastructure element when the system is under load
Hired, trained and managed a Software Engineer to work on my team to support client side API testing
Modified existing test framework to test VidyoConnector APIs (used on Vidyo.io cloud based platform)
Managed the development of a traffic generator to aid in the testing of Vidyo infrastructure. This tool was designed to scale across many servers (100+) and could perform a variety of test scenarios
Managed the development of a test tool to test our clients in a variety of constrained environments (network, CPU). 100+ test cases were created and run
Managed the development of a next generation test framework that would eventually allow for VidyoClient APIs to be tested on all supported platforms (Windows, MacOS, Linux, Android, iOS, Browsers). Initial version was able to test C APIs on all platforms and JavaScript APIs on browsers (utilizing Selenium)
Continue to enhance the CI/CD of the test platform, to help ensure that any issues with the libraries on any of our supported clients could be caught as early as possible in the development process
Wrote an automation test framework to test the VidyoClient C APIs on Windows, MacOS and Linux. The core application was written in C++ and was utilized via a set of machine generated Python bindings. All test cases were written in Python. Wrote several hundred test cases against 3 different back ends. Each python test case could be run on all platforms (write once, run everywhere)
Ran tests in a CI/CD environment (Bamboo), on every commit into the underlying libraries a sanity was run, plus full regression was run on a nightly basis
Performed performance testing of Vidyo infrastructure components (Portals, Routers and Gateways), tested both physical hardware performance (different server configurations) and the same components run virtually (on VMware). Wrote a number of tools in Bash, Node.js and Python to record and analyze metrics for these tests
Managing a team of three engineers. The team is responsible for QA testing for the following products:
•SmartWorks - call recording software and hardware for both VoIP and TDM (digital and analog). This includes testing the SDK, its API, as well as all associated software (including hardware drivers).
•SmartTap - full solution for Recording and Playback of voice calls. We test all supported interfaces (Analog, Digital (TDM), various VoIP (Avaya, Cisco, SIP, Microsoft Lync, etc), it's web interface, perform load testing, perform various load failure test scenarios, upgrade tests, etc.
•HPXMedia - High density media server which supports all major telephony codecs (G.711, G.729, G.723.1, Siren, msrta, etc)
The team maintains and builds a variety of tools to test all of these products. These tools are written in a variety of languages, including C++, .NET, Ruby, Python and Java.
In addition, I'm responsible for the following:
•Managing the entire software ticket tracking system for QA (AccuRev). This entails evaluating each ticket generated by QA, software development or the support team and then determining which resource can best work the ticket (once it's assigned to QA for verification), and then monitoring it's progress through it's life cycle.
•All SmartTap Microsoft Lync testing. Worked with Microsoft during two formal certification cycles of the SmartTap product, for which SmartTap gained certification each time. Also built and maintain an Enterprise Lync lab environment (Lync 2010 and 2013). I also wrote and maintain a Lync voice load simulator (UCMA 3.0, in .NET) and a tool to automate all call flows with the PC based Lync client.
•Responsible for performing yearly reviews of all team members, in which I set and evaluate goals for each team member. I've also participated in interviewing and hiring new team members.
•Responsible for all testing schedules and time lines.
•Participate in the planning and discussion of all new features for the product.
Lead QA engineer on the Telcordia Advanced Service Management System (ASMS) for Hosted Solutions. Produce test plans, write test cases, and run test cases against versions of the ASMS system before it gets deployed in a production environment to handle all provisioning requests for a mobile virtual network operator (MVNO). Submit trouble reports (TR’s) for any issue found and work with developers on potential fixes.
Worked for the ATM and Broadband Integration group:
•Co-developer of the Telcordia Test Analyst, a web based application that Telcordia used to allow full transparency of all testing operations for Phase I of the Global Information Grid Bandwidth Expansion (GigBe) project. This was a complete Trouble Report / Modification Request (TR/MR) management system. The application had to be extensively customized in order for it to fit into an existing testing environment, and meet all of the requirements of the DOD/SAIC/AT&T/Telcordia personnel who where overseeing the project. The technologies involved for this project were: PHP, MySQL, Apache, and Solaris.
•Lead system engineer on the Telcordia Digital Work Design project. In this initiative Telcordia used many of the existing Product Lifestyle Management (PLM) tools in use primarily in the Aerospace and Automotive industries and applied them to the telecommunications industry in order to help reduce cost and process inefficiencies on various fiber to the premises (FTTP) installations.
•Developed ADSL automation software. The software was based on the DSL forums test plan for testing ADSL modems (TR-67). The test platform was developed with a variety of Spirent/Adtech hardware and software.
•Lead tester for the New York City Transit (NYCT) project. NYCT contracted with Telcordia to evaluate the effectiveness of two ATM/IP solutions from different vendors, which involved interoperability testing with a simulated NYCT network environment. This included legacy switched circuits (data and POTS) as well as IP and ATM. I used Spirent/Adtech hardware as well as network protocol analyzers (such as ethereal) in order to perform the testing.
•Lead programmer of a real-time Asynchronous Transfer Mode Private Network to Network Interface (ATM PNNI) Network Emulator. This system is used by service providers to validate routers prior to network acceptance and by suppliers developing PNNI enabled network routers.
•System Architect in the development of applications used in testing Integrated Digital Loop Carrier (IDLC) equipment. Actively managed the projects of several interns, all of which culminated in the development of applications which are actively used internally at Telcordia.
•Performed GR-303 technical analysis on many different access systems. Tested extensively with both the Lucent 5ESS and the Nortel DMS-100 switches. Worked closely with the customers and offered potential solutions to problems discovered. Wrote 60+ page technical analysis reports in Frame Maker detailing results of all testing.
Ported a legacy C program to Sun’s Solaris 7 and then updated the program to meet the latest requirements. The software is used extensively by engineers to analyze and test GR-303 systems, also developed a Java front end for a legacy C application
Managed all of the groups computer systems, which included Windows NT Servers/Workstations, an IBM RS/6000 Server, and a Microsoft SQL Server, as well as a web server.
•Managed several Novell Servers, and worked as a PC Support Technician for Windows 95 and Windows 3.x at the company’s corporate headquarters.
•Maintained the network infrastructure (10/100 Mbps Ethernet) at the corporate headquarters.