Wholesale: Products & Services

Archived System CR SCR021414-1 Detail

Expected Deliverables: A standalone test environment for MTG similar to IMA SATE

Status History

Project Meetings

12/17/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink said in the November 2014 CMP meeting, CenturyLink reviewed the updated CR response following the four month trial. He said the proposed redline changes to the Job Aid were reviewed and Kim Isaacs, Integra, agreed to the proposed modifications which were basically to eliminate a specific day and keep the structure of the testing in place. CenturyLink sent a System Courtesy notice on December 16, 2014 to wholesale customers that utilize MTG to provide the MTG testing Job Aid. The effective date will be January 16, 2015. We will review the CR again next month. Mark asked if that was OK with Integra.

Kim Isaacs – Integra said that was fine.

11/19/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink said there was a four month trial associated with this CR that completed as of October 1. Mark said during the October CMP meeting, CenturyLink indicated we would revise the CenturyLink CR draft response based on results of the trial. He then reviewed the CenturyLink Draft response indicating that only two CLECs utilized the MTG test environment and that testing was not requested on the designated Wednesday as proposed for the trial. Mark said the proposed changes to the MTG Testing Job Aid include eliminating a specific day of the week for MTG testing while maintaining the structure and process on how to request MTG testing. Mark asked if there were any questions on the response. There were none.

Rich Rockwell – CenturyLink then reviewed the MTG Testing Job Aid redline updates included in the package. Rich said in addition to the change to not require the MTG testing to be performed on a specific day of the week, CenturyLink is requesting any CLEC testing in the MTG environment send an email to the EIS team mailbox when their testing is complete to allow CenturyLink resources to be freed up. Rich asked if there were any questions on the process. There were none.

Kim Isaacs – Integra said thank you for the four month trial and for the ongoing process and indicated she was good with the proposed redline updates to the Job Aid.

Mark Coyne – CenturyLink said the next steps are for CenturyLink to send a system courtesy notice to inform all customers of the ongoing MTG testing process. The MTG Job Aid would then be posted to the MTG system page.

10/15/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink said we completed the four month trial from June 1 to October 1 and said that two CLECs requested testing in the environment but that it was not for the designated day of Wednesday. Mark asked for CLEC feedback before deciding how to move forward. There was none. Mark proposed that CenturyLink send out a revised response indicating how the MTG Testing Job Aid would be modified as a result of the trial. The plan is to basically loosen up the formality of the test and not focus on Wednesday as the dedicated day for testing. CenturyLink will continue to keep the structure of how to request testing and would post the process externally. We would also continue to track test requests and environment utilization. Mark asked if that was OK with Integra.

Kim Isaacs – Integra said based on that information, it seemed the right path.

9/17/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink said we are wrapping up the four month trial. Mark said we agreed to identify each month if there were any black out times for requested testing for the month ahead and there are none for the next month. Mark said once the trial completes, we will likely send out a draft response to Integra based on what we see as the trial results.

8/20/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink said one CLEC has requested testing in the MTG Test environment. Mark said per the MTG Testing Job Aid, CenturyLink is to identify each month if there were any black out times for the month ahead and there are none for the next month. Mark said the trial continues through October 1.

7/16/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink said on July 1, 2014, a notification was sent to all customers to identify the availability of the MTG Test environment trial which was extended to October 1. Mark said at this time, there are no black out dates to report for the test environment. The Job aid for the Trial was an attachment to the July 1 notice and it is also posted to the MTG system web page. Mark said currently, no customers have requested the use of this environment.

6/18/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink said last month a proposal had been reviewed for a three month trial regarding scheduling time and support in the MTG test environment. CenturyLink had suggested the Trial begin June 1 through September 1. Mark said that no requests had been received to date. CenturyLink will issue a notice to inform all customers of the existence of the availability of the MTG Test environment trial and the trial will be extended to end October 1. Mark asked if there were any questions. There were none.

5/21/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink provided a background on the CR relaying Integra had issued the CR in February and that CenturyLink issued a draft response in March identifying that the CR was Accepted if CenturyLink and Integra would work together to consider some lower impact options to improving the MTG test environment. The various options were reviewed in the March meeting. Mark said Integra agreed in the April meeting to proceed in consideration of Option 1 which is to Establish a weekly dedicated window to provide CLEC MTG testing. CenturyLink is proposing a three month Trial for Option 1 that includes a High level LOE estimated to be less than 100 hours.

Denise Martinez – CenturyLink then reviewed the Draft Job Aid as included in the package.

Kim Isaacs – Integra asked if the first available MTG test window was June 4.

Denise Martinez – CenturyLink said the trial was to start on the June 1 which would make the first available test date June 4.

Susan Lorence – CenturyLink said then the first request for the MTG environment would need to be received on May 28.

Denise Martinez – CenturyLink continued review of the Draft Job Aid.

Mark Coyne – CenturyLink asked if the lead time was five business days or calendar days for the request to be received.

Denise Martinez – CenturyLink said we would need to confirm but she thought it was business days.

NOTE: Update to the meeting minutes, as identified in the Assumptions section of the Job aid matrix, “A CLEC would contact CenturyLink five business days prior to needing to utilize the Wednesday test environment.” Mark Coyne – CenturyLink asked if there were any other questions for Denise. There were none.

4/16/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink said in the March CMP meeting, several implementation options for the CR were reviewed. It was agreed that Option 1 which was to establish a weekly dedicated window to provide CLEC MTG testing would be the next step. Mark asked if Kim Isaacs – Integra had any further feedback on Option 1.

Kim Isaacs – Integra said Option 1 was acceptable to Integra if it could be implemented in 2014.

Mark Coyne – CenturyLink said the next step was to provide a more detailed LOE for Option 1 and then provide a process to support the implementation. Mark said the approach was that if there was no customer request for a test window, the environment would not be made available.

Kim Isaacs – Integra agreed.

Mark Coyne – CenturyLink said we will have more information in May and a tentative date for implementation.

3/19/2014 Monthly Systems CMP Meeting Mark Coyne – CenturyLink said this CR was presented by Integra in the February CMP meeting. A clarification call was held on February 25, 2014. Mark said the SME team evaluated the CR and a draft response was sent on March 12 to indicate that CenturyLink accepts the CR with the idea that we work together to take progressive steps to improve MTG testing. The MTG Test Environment Options matrix was developed that we would like to review. Mark suggested we complete the review of the Systems Distribution package and then come back and review the MTG Test Environment Options matrix at the end of the systems meeting.

Kim Isaacs – Integra said she was OK with that.

* Discussion following the regular agenda for the March monthly CMP meeting

CLEC Participants on this portion of CMP call - Kim Isaacs – Integra, Liz Tierney – MegaPath, Carol Frike Midcontinent Communications, Laurie Roberson – Integra, Victor Gaither – TWCable CenturyLink Participants: Denise Martinez, Nicole James, Jim Rearden, Vinesh Vijayan Leela, Lori Burchett, Cecilia Tank, Rita Urevig, Susan Lorence, Mark Coyne

Denise Martinez – CenturyLink reviewed the MTG Test Environment Options matrix as available in the CMP System Distribution package. Denise provided a high level description of each Option and included the review of the Timing, Additional information, Cost and Assumptions associated with each one. Denise said CenturyLink did not consider Option 4 due to cost and then reviewed the Additional considerations.

Kim Isaacs – Integra said thank you for providing the MTG Testing options and that she would be reviewing them further. Kim said she needed to understand the relationship of Option 3 in conjunction with the Verizon CR. Kim asked if Option 1 or 2 would be able to proceed in 2014.

Denise Martinez – CenturyLink said we would need to take that back as we develop the LOEs.

Kim Isaacs – Integra said she wants to be pragmatic in regard to the CR and is aware that Option 3 is costly. She said there may be trade offs this year but if neither Option 1 or 2 can progress this year, she will continue to request Option 3. Kim asked if CenturyLink could begin work on Option 1 this year.

Mark Coyne – CenturyLink said we would like to take a phased approach on this CR and add to the test environment step by step to provide something useful since there is no bottomless budget. Mark said he could not commit for IT at this point.

Kim Isaacs – Integra said a phased approach looks good and that she is willing to consider a phased approach especially if the effort for Option 1 and possibly Option 2 starts in 2014. Kim said Option 2 looks like it may be what is required for a good period of time and then they can then see what might be required beyond that.

Mark Coyne – CenturyLink said CenturyLink and Integra should take the options back and work with their IT folks to consider what can occur in 2014.

Denise Martinez – CenturyLink said she wanted to point the bottom of the document to point out the high level cost assumptions at this point.

Mark Coyne – CenturyLink said he also wanted to point out that there are also no planned releases for MTG, that a standalone environment would be costly and that CenturyLink would like to track some history of CLEC usage and interest before moving forward with development of a full test environment.

Kim Isaacs – Integra said that was fair but wanted to get some relief from the current process. Usage history would be helpful to see how things are working.

Susan Lorence – CenturyLink suggested we take Option 1 back to IT to see what it would take to get a firm LOE. Kim Isaacs – Integra said that would be good to move forward with a phased approach starting with Option 1 and then can see how that works. Kim said she may want to request other changes in this area.

Mark Coyne – CenturyLink said we learned from the IMA GUI test CR last year.

Kim Isaacs – Integra said she was open to that for this CR.

Mark Coyne – CenturyLink asked if there were any other questions. There were none.

2/25/14 Clarification Call Attendees: Kim Isaacs – Integra Laurie Roberson – Integra Steph Prull – Integra Vinesh Vijayan Leela – CenturyLink Denise Martinez – CenturyLink Lori Burchett – CenturyLink Mark Coyne – CenturyLink Rich Rockwell – CenturyLink Susan Lorence – CenturyLink

Susan Lorence – CenturyLink opened the call and recapped the purpose of the clarification call.

Steph Prull – Integra then presented the Integra CR. Steph said the CR is straight forward. Integra would like an application to application test environment for MTG like what IMA has with SATE. Steph said it takes time to coordinate testing and Integra would like the ability to test MTG and get different responses back and not have to tie up CenturyLink resources to manually respond.

Susan Lorence – CenturyLink said the CR description included a reference that it was difficult to schedule MTG testing due to support staff issues. Susan asked for more information and whether it was due to the manual responses.

Steph Prull – Integra said it was a little challenging to start testing with MTG and that there was a change in CenturyLink staff in the middle of testing. Steph said there was lots of things going on for both companies and that some of it was growing pains associated with them using MTG for the first time. Some things went well, others did not. Steph said she had users asking what was happening with responses. She said it would be good to move toward a standalone environment – especially in off release testing. When Integra makes a change, Steph said they could “shoot it through” and not tie up CenturyLink resources to manually respond. Steph said this would help both teams.

Rich Rockwell – CenturyLink said test scheduling is a coordinated effort today and CenturyLink is open to whatever window a CLEC wants. Rich said all CLECs testing MTG were handled the same way and were successfully implemented. Rich said he was sorry for the speed bumps Integra experienced. He needed to understand if Integra is looking for a broader window and more frequent testing. He asked if Integra wanted to test every day, on weekends/evenings and asked what volumes Integra was looking at.

Steph Prull – Integra said she could not say as they were still working on internal system hookups. Steph said they may make changes a couple days a month and that the environment was needed for their regression testing. She is looking for an environment like SATE – Monday thru Friday, 8 to 7 but not typically nights/weekends. Steph said it would not be 100 transactions a day but more like 4-5 tickets a week for Integra but other carriers would have other volumes. Steph said Vinesh did a great job but they had some speed bumps. Steph said she did not want to tie up a CenturyLink person when they needed a ticket manually processed.

Susan Lorence – CenturyLink said there was a reference in the CR to independent testing. Susan asked if Rich could describe how testing occurs today.

Rich Rockwell – CenturyLink said there is a difference between testing with a “round trip ticket” with a true response from downstream systems vs. connectivity or regression testing. Rich said that is an important clarification compared to the regression test environment available today. Rich said it sounds like Integra is looking for the life cycle of a real ticket which is important to understand.

Steph Prull – Integra said in a perfect world, she would like MTG to be like SATE. It does not matter whether it is regression or release testing, CenturyLink would be aware of testing but not be on top of it. Steph said it will likely take time to build this up and the focus is regression testing for now. In a perfect world, she would like to test a “round trip ticket” that allows multiple paths for a ticket with different responses with a focus on the most common responses. If things were perfect, it would be good to test all scenarios but that would take time and effort.

Rich Rockwell – CenturyLink said SATE is solid and it has the 30 day test lead time prior to new IMA releases. Rich said he is not anticipating that MTG will have multiple large releases per year. He expects MTG to be like MEDIACC which was stable and with limited enhancements. Rich said that must be a consideration. He said it sounds like Integra is talking about the ability to do regression testing all year.

Steph Prull – Integra agreed and said the focus is regression testing to insure they did not break something.

Vinesh Vijayan Leela – CenturyLink said in today’s world, CenturyLink simulates the downstream response based on the request.

Steph Prull – Integra said it might take baby steps but she would like to take those manual responses out of CenturyLink hands and free up resources.

Rich Rockwell – CenturyLink said that clarification helps.

Susan Lorence – CenturyLink said we looked at what we provided with MEDIACC, what is different and what is included in the CMP document in Section 11.0, Application to Application Interface testing. Susan said for pre-ordering and ordering, the CMP document identifies a standalone test environment but for repair, it identifies a customer test environment. Susan said we thought MTG testing met that requirement the same as MEDIACC had.

Steph Prull – Integra said she needs to look at that language in the CMP document but that at a high level, because CenturyLink provided a test environment for MTG, that requirement was met.

Susan Lorence – CenturyLink said that CMP language is simple.

Steph Prull – Integra said she is looking for an enhancement to the current environment.

Kim Isaacs – Integra said she agrees Integra is looking for an enhancement to benefit both companies.

Susan Lorence – CenturyLink recapped a couple points from the discussion: The enhancement to the testing environment is not tied to a release, it will be for regression testing, and is intended to free up resources. Susan said part of the consideration for this CR is the amount of resources we have for 2014. We have one MTG CR that is already scheduled for May which is associated with updating the GMT. Susan said there is a newly submitted Verizon system CR as of February 19 and a clarification call was just scheduled for that CR on February 27. Susan said the CRs will be competing for the hours available for 2014 and that she thought the Repair hours available for 2014 was 1600. NOTE: The actual available hours for Repair releases in 2014 is 1900 hours.

Kim Isaacs – Integra said prioritization would then be required for the two CRs.

Susan Lorence – CenturyLink said that was correct as long as this CR is accepted. Susan said we need to evaluate the CR to do a high level LOE and determine benefits. If the CR is accepted, we would need to go through prioritization. Susan asked if there were any questions.

Steph Prull – Integra said if CenturyLink had questions on what was being requested or different options, feel free to call.

Susan Lorence – CenturyLink said the SME team would be evaluating the CR. The meeting minutes would be available in five days.

The clarification call concluded at 2:55 PM MT.

2/19/14 System Monthly Meeting Kim Isaacs – Integra presented the new Integra CR that is requesting a new testing environment for MTG similar to IMA. Kim asked if there any questions. There were none.

Susan Lorence – CenturyLink said a Clarification call was scheduled for Tuesday, February 25 at 2:30 PM MT and other CLECs could also join the call. Susan said she would add the call to the Wholesale Calendar.

CenturyLink Response

Kim Isaacs Integra

SUBJECT: Integra CR SCR021414-1, DRAFT RESPONSE for Review This letter is an updated response to CLEC Change Request SCR021414-1, Develop Stand Alone Test Environment for MTG.

CR Description: CenturyLink’s recent changes to its system support staff have led to difficulties in scheduling MTG testing. Integra is requesting the ability to independently conduct MTG testing in a standalone test environment, similar to IMA SATE.

Expected Deliverables: A standalone test environment for MTG similar to IMA SATE.

History: A clarification meeting was held on February 25, 2014 with Integra and CenturyLink representatives in attendance. The discussion in the Clarification call was that the initial focus of the MTG Testing environment was for regression testing and that it would not necessarily be tied to a MTG release. Integra also indicated a willingness to take baby steps toward developing an environment to perform testing of software changes impacting MTG. CenturyLink accepted the CR with the approach that CenturyLink and Integra would work together to take progressive steps toward improving the MTG test environment. A matrix of possible MTG Test environment options was developed and discussed at the April and May monthly CMP meetings. Option 1 was chosen and an MTG Testing Job Aid was developed for use in a four month trial lasting June through September 2014.

CenturyLink Response: During the MTG Test environment trial, only two CLECs utilized the MTG test environment; testing was not requested on the designated day as identified in the MTG Testing Job Aid. As a result of the trial, CenturyLink is proposing the MTG Testing Job Aid be modified (see attached) to reduce the overhead of maintaining a dedicated day each week for testing. The structure for testing would be maintained and the process on how to request testing and track test requests and environment utilization would also be retained. Upon review, CenturyLink will incorporate any agreed upon changes to the process. A system courtesy notice would then be distributed to inform all customers of the ongoing testing process for MTG and the Job Aid would be posted to the MTG system page.

Sincerely,

Susan Lorence CenturyLink CR Project Manager

March 12, 2014 Kim Isaacs Integra

SUBJECT: Integra CR SCR021414-1, DRAFT RESPONSE for Review

This letter is in response to CLEC Change Request SCR021414-1, Develop Stand Alone Test Environment for MTG

CR Description: CenturyLink’s recent changes to its system support staff have led to difficulties in scheduling MTG testing. Integra is requesting the ability to independently conduct MTG testing in a standalone test environment, similar to IMA SATE.

Expected Deliverables: A standalone test environment for MTG similar to IMA SATE.

History: A clarification meeting was held on February 25, 2014 with Integra and CenturyLink representatives in attendance. The discussion in the Clarification call was that the initial focus of the MTG Testing environment was for regression testing and that it would not necessarily be tied to a MTG release.

CenturyLink Response: During the February 25, 2014 Clarification call, Steph Prull - Integra indicated Integra was willing to consider taking baby steps toward developing an environment to perform testing of software changes impacting MTG. With that in mind, the CenturyLink SME team is developing a matrix of possible MTG Test environment options. We plan to share a draft of that matrix with Integra and the CLEC community as part of the CMP System package for the March meeting. CenturyLink is accepting this CR with the intent that Integra and CenturyLink will be able to work together to take progressive steps toward improving the MTG test environment.

Sincerely,

Susan Lorence CenturyLink CR Project Manager