Wholesale: Products & Services

Archived System CR SCR063003-02 Detail

Qwest to develop a test database that would allow CLECs to test Qwest’s IMA GUI before major and point releases are implemented. Because Qwest does not offer testing, the CLECs GUI users are faced with significant issues that impact our ability to submit LSRs to Qwest in the IMA GUI. Qwest assign’s severity codes as problems are identified through system trouble tickets, based on volume and CLEC impact. For example, in the 12.0 release, an edit was implemented to edit for alpha characters in the hunt sequence. However, there are alpha characters required for some types of hunt sequences and ported numbers. This had a significant impact to Eschelon, but not necessarily to the entire CLEC Community because of product set and EDI. Because Qwest views the impact as minimal, the fix will not be implemented until the 13.0 release. These situations happen with each release. If Qwest offered testing before releases, such as SBC (discussed in June CMP meeting) these issues could be identified and resolved before the release. The impact to CLECs LSR is significantly impacted without testing.

Expected Deliverables/Proposed Implementation Date (if applicable):

Qwest will develop a test database for the IMA GUI. This test database will allow CLECs to test the IMA GUI before major and point releases. The CLECs experience significant impacts to LSR submittal because Qwest does not have the ability to test.

Status History

Project Meetings

09/18/13 System CMP Meeting Mark Coyne – CenturyLink said a level 2 notification had been sent on August 23 to relay the implementation plan. The effective date was September 13; there were no formal comments. On September 13, CenturyLink sent a system notice for IMA Release 35 to identify that the 1st Look would be held on October 28 and to determine if we had any CLECs interested in participating. Mark said there was one CLEC that signed up so far so we will be holding the IMA 1st Look at Production. He said the CR is now in CLEC Test and we propose leaving the CR there until we utilize this new planned 1st Look with this first release.

Kim Isaacs – Integra said during the CLEC community call, there was a question as to whether the CR impacted XML testing. Kim said her understanding was that it only impacted GUI testing and would not impact XML.

Mark Coyne – CenturyLink said that was correct.

07/17/13 Systems CMP Meeting - Under Attachment I The action item associated with this CR was covered at the end of the monthly meeting. See meeting minutes under Attachment N.

System Meeting minutes under Attachment N Denise Martinez – CenturyLink walked through the attachment that was posted to the Wholesale calendar. Denise reviewed the Background, the Proposed Approach and Test Data sections of the document. Denise asked if there were any questions associated with each section; there were none. Denise reviewed the CenturyLink proposed approach for the upcoming IMA Release 35 which was to move the 1st Look to Monday with no use of test data with that release. With the subsequent releases beginning with IMA Release 36, use of test data would be considered on a release specific basis. Denise said CenturyLink proposed sending a level 2 CMP notice to the full CLEC community to relay this plan. Denise reviewed the Oustanding issues section and referenced the updated matrix that shows recent Utilization of IMA 1st Look and then asked if there were any questions.

Kim Isaacs – Integra said she did not have any questions but said the phased approach as outlined was acceptable and that it looked good.

Mark Coyne – CenturyLink asked if it was OK to move forward with a level 2 CMP notification.

Kim Isaacs – Integra said it was OK with Integra.

Al Finnell – Windstream said he would check internally but it looked good as well.

Susan Lorence – CenturyLink said there will still be an opportunity for CLECs to provide formal comments during the level 2 notification timeline.

Mark Coyne – CenturyLink asked if any other participants had any comments. There were none.

06/19/13 Systems CMP Meeting Mark Coyne – CenturyLink said the CenturyLink draft response had been sent to Integra on June 14, 2013 to confirm the alternative solution to conduct the 1st Look at Production following an IMA release installation on Monday. Mark relayed that also included would be some capability to input test data into the 1st Look at Production environment. Mark said the details of the alternative process are still being developed and hopefully will be worked out by August so the process can be utilized with the IMA Release 35 in October. Mark asked if there were any questions. There were none.

05/15/13 Systems CMP Meeting Susan Lorence – CenturyLink said CenturyLink developed options for this CR which were presented in the CMP March meeting. She said last month Kim Isaacs – Integra had relayed the Integra preference is to hold the 1st Look on Monday with the capability to input test data though that functionality may not always be used. Susan asked if there are any changes to that or if that had been discussed further in the CLEC community meeting.

Kim Isaacs - Integra said the CR had been discussed in the CLEC Community meeting and that there were no objections in that forum to moving the 1st Look to Monday. Kim asked if a notice would be sent announcing the change since not all CLECs participate in the meeting.

Susan Lorence – CenturyLink said based on Integra’s agreement on the approach for this CR, CenturyLink will send out a formal response that relays the final direction for the CR. Susan said we may need to schedule a follow-up call to discuss how the optional test data aspect will be implemented. Once agreement is reached on the test data approach, CenturyLink will send out a notice to the CLEC community to relay the change.

Kim Isaacs - Integra said she agreed on that approach.

Susan Lorence – CenturyLink asked if there were any questions. There were none.

04/17/13 Systems CMP Meeting Mark Coyne – CenturyLink said this CR was presented at the end of the CMP March meeting where we walked through several scenarios identified by CenturyLink . Mark said CLECs were to review the scenarios internally to provide their thoughts on how to move forward and asked if anyone had any feedback on the options.

Kim Isaacs - Integra said she had discussed this internally and the direction preferred by Integra is to move the 1st Look to Monday AM following the IMA release install. She said they like the ability to create test data. Kim said she mentioned this CR on the CLEC community call which did not have a lot of participation. For those on the call, there were no concerns moving 1st Look from Sunday to Monday but asked CLECs on the call today to weigh in.

Mark Coyne – CenturyLink restated that the Integra preference is to hold the 1st Look on Monday with input of test data allowed.

Kim Isaacs - Integra said yes but that input of test data may not be required in all 1st Looks but they wanted the option.

Mark Coyne – CenturyLink said we would let the other CLECs consider this and then determine how to move forward in the next meeting.

03/20/13 Systems CMP Meeting Susan Lorence – CenturyLink provided a very brief history of this CR which goes back to 2003. The CR was in a Deferred status from 2007 until last year. The full CR history is available on the CR website. The original LOE was significant per IMA release to establish the IMA GUI Test environment. The CenturyLink SME team has been working to develop several scenarios for CLEC review. Susan said one of the biggest concerns with this CR is that there is an implication that if the CR was implemented, that if a problem were found in the Test environment, it could delay the release implementation. Susan referred to a NOTE in Attachment O to insure there was an understanding that any potential problem found in any Test environment would be addressed per Section 12.0, Production Support, of the CMP document.

Denise Martinez – CenturyLink reviewed the information included in the CMP package. She said the scenarios had been developed by the SME team based on the following: IMA releases have gotten smaller over the years; there are not as many extensive functional changes; there is some ability to test IMA in the First Look at Production; and that the IMA candidates are reviewed during the IMA release walkthrough which helps answer CLEC questions. Denise referenced the large LOE of 10,000 hours per release that was provided previously on the original CR. It was identified that IMA does not have 10,000 hours per release any longer. Denise referenced recent analysis of the First Look at Production attendance which shows only two instances that CLECs have participated in the First Look in the last nine releases. Denise also reviewed a matrix that shows only four IMA GUI specific trouble tickets have been identified in the last nine releases.

Denise Martinez – CenturyLink then reviewed the four high level scenarios and the additional information associated with each scenario that CenturyLink had developed. The four scenarios are: 1) Go back to using the First Look at Production a. Continue with First Look on Sunday b. Continue with First Look on Sunday but allow use of test data with the possibility of a separate login specific to each CLEC 2) Establish a First Look on Monday following the release a. Continue with First Look but on early Monday b. Continue with First Look but on early Monday but allow use of test data with the possibility of a separate login specific to each CLEC 3) Add a GUI testing window in the SATE environment; includes the possibility of using XML test data 4) Utilize the Training environment for GUI testing in advance of the release with specific test data; requires a significant amount of additional coordination. Jim Rearden – CenturyLink identified that the reason that CLEC testing could not occur in the IMA production environment prior to First Look is that a significant amount of testing occurs with the CenturyLink downstream systems over the weekend. Some of that interfacing system testing does not complete until Sunday which then requires IMA to retest the production environment prior to testing with the customers.

There was discussion as to the cost of each of the scenarios. Scenarios one and two could have a small amount of incremental cost depending on whether option a or b were used. The additional cost would be if CLEC test data would have to be established and then subsequently backed out at the completion of the test. In regard to Scenario 3, the additional cost would be support costs, test data support, but a more refined LOE would be provided when a better understanding of more specific CLEC requirements associated with this CR were available. In regard to Scenario 4, this was referred to as the “Cadillac” version as it requires considerably more environment and hardware setup, downstream coordination, test data development, support staff, etc.

The T shirt size costs that are included at the end of the attachment include hardware costs, test systems, setup costs, backend system support personnel, etc. not just IMA hours.

Denise Martinez – CenturyLink reviewed the Additional Considerations listed that include resolving how the GUI Test costs will impact the IMA hours available for each release, what are the timelines to implement any of these testing scenarios, what happens if only a small number of CLECs are interested in testing, etc. Denise asked if there were any questions.

Kim Isaacs – Integra said she would like to take this information back to her staff and review the scenarios. She said Scenario 2b is most likely and practical though Scenario 3 using SATE is interesting. She thought 2b would likely provide what they are looking for. She mentioned several general concerns: Sundays are a problem, the upcoming LSOG CRs may have bigger impacts, etc.

Mark Coyne – CenturyLink said that the IMA hours will very likely not be increasing which has to be taken into consideration although the SCRP process could possibly be used.

Denise Martinez – CenturyLink said that the current IMA testing approach has evolved to work very well and that IAM testing team has been together for awhile which resulted in fewer problems with a release.

Kim Isaacs – Integra said she has seen the results of the testing team evolution and appreciated the development of the scenarios. Kim said she would bring this up on the next CLEC community call next month and would also review the scenarios with her team and hoped to have a direction by the April meeting.

Mark Coyne – CenturyLink said we would make discussion on this CR an Action item for the April meeting. Mark asked if there were any other questions. There were none.

02/20/13 Systems CMP Meeting Mark Coyne – CenturyLink said in the January CMP meeting, we said we would put together some possible testing scenarios for consideration. Mark said those scenarios were in the package but that the plan was to review them in more detail in the March meeting. Mark asked if that approach was OK with the group.

Kim Isaacs – Integra said yes.

Denise Martinez – CenturyLink reviewed the information included in the CMP package. She said the scenarios had been developed based on the following: IMA releases have gotten smaller over the years; there are not as many extensive functional changes; there is some ability to test IMA in the First Look at Production; and that the IMA candidates are reviewed during the IMA release walkthrough which helps answer CLEC questions. Denise referenced recent analysis of the First Look at Production attendance and then reviewed the four scenarios that CenturyLink had developed: 1) Go back to using the First Look at Production 2) Establish a First Look on Monday following the release 3) Add a GUI testing window in the SATE environment 4) Utilize the Training environment for GUI testing in advance of the release. Kim Isaacs – Integra asked if the LOEs would be available in March for options 3 and 4.

Denise Martinez – CenturyLink said we are hopeful we will have the LOEs by then.

Kim Isaacs – Integra asked about option 2 whether the Monday would be similar to the approach on Sunday which includes a bridge, etc. Kim said it is true that recent releases have been smaller but that upcoming releases in 2013 will be bigger, pointing to the upcoming LSOG changes.

Denise Martinez – CenturyLink said that was a good point. In regard to option 2, the plan was for it to be similar to what occurs on Sundays. Denise said we are looking for any ideas and feedback the CLEC community may have to make testing more successful.

Susan Lorence – CenturyLink said that if anyone has any additional ideas on testing, to please forward them in advance to the CMPCR mailbox for consideration in March.

Mark Coyne – CenturyLink said that would be helpful and asked if there any other questions. There were none.

01/16/13 Systems CMP Meeting Mark Coyne – CenturyLink CR said the CR was placed in Deferred in 2007 and reviewed the original LOE for IMA which was 1250 to 2000 hours plus the LOE for SATE of 2760 to 4600 hours. Mark said there were ongoing release impacts of 10,000 hours. Mark said the CenturyLInk SME team is developing some possible testing scenarios/options that include: • what processes would be supported, • what data would be available, • what timeframe the testing would be available, and • what are release impacts if a specific testing scenario were to be implemented Mark said we are proposing that we share the proposed high level scenarios in the February meeting. Then during the March Face-to-Face meeting, we would review and discuss the scenarios for CLEC input and add CLEC benefits. Mark asked if that would work for everyone.

Kim Isaacs – Integra said that would work.

Jeff Sonnier - Sprint questioned the CR title that said EDI instead of XML.

Mark Coyne – CenturyLink said that is because the CR was issued back in 2003.

08/15/12 Systems CMP Meeting Mark Coyne – CenturyLink said that a Deferred List was included and that the two CRs on the list, SCR063003-02 and SCR112003-03, would be moved to Evaluation status.

8/7/07 E-mail from Eschelon

Lynn,

Since the LOA is larger than Qwest even allows for in a single release now, and we would need to reevaluate the CR and the LOA, you can place this CR in a deferred status for the time being.

Bonnie Johnson

Director Carrier Relations

Eschelon Telecom Inc.

Phone 612 436-6218

Fax 612 436-6318

Cell 612 743-6724

bjjohnson@eschelon.com

-

From: Stecklein, Lynn [mailto:Lynn.Stecklein@qwest.com] Sent: Tuesday, August 07, 2007 10:50 AM To: Johnson, Bonnie J.; Isaacs, Kimberly D. Subject: FW: SCR063003-02 Develop Test Capability in GUI

Hi Bonnie and Kim,

We are in the process of reviewing eligible candidates for the IMA 23.0 Release and have a question on the attached CR. Is there any change to the CR based on the e-mails below?

Thanks!

Lynn

-

From: Johnson, Bonnie J. [mailto:bjjohnson@eschelon.com] Sent: Wednesday, January 25, 2006 6:58 AM To: Stecklein, Lynn Subject: RE: SCR063003-02 Develop Test Capability in GUI

Lynn,

For the time being I would like it to remain. When we discuss the CRs for 20.0 prioritization as a group, I may choose to defer it.

Thanks,

Bonnie Johnson

Director Carrier Relations

Eschelon Telecom, Inc.

Phone: 612 436-6218

Fax:612 436-6318

Cell: 612 743-6724

--Original Message-- From: Stecklein, Lynn [mailto:Lynn.Stecklein@qwest.com] Sent: Tuesday, January 24, 2006 11:47 AM To: Johnson, Bonnie J. Subject: SCR063003-02 Develop Test Capability in GUI

Hi Bonnie,

We are in the process of compiling all the IMA 20.0 candidates. I have a question about SCR063003-02 (Develop Test Capability in GUI to Allow Testing Before Major and Point Releases). In February of 2005, you stated that you were working through other processes to accommodate this request. Do you still want this CR to remain on the IMA 20.0 candidate list? Let me know.

Thanks!

Lynn Stecklein

Qwest Wholesale CRPM

303 382-5770

This communication is the property of Qwest and may contain confidential or privileged information. Unauthorized use of this communication is strictly prohibited and may be unlawful. If you have received this communication in error, please immediately notify the sender by reply e-mail and destroy all copies of the communication and any attachments.

1/25/06 E-mail From Eschelon

Lynn,

For the time being I would like it to remain. When we discuss the CRs for 20.0 prioritization as a group, I may choose to defer it.

Thanks,

Bonnie Johnson Director Carrier Relations Eschelon Telecom, Inc.

Phone: 612 436-6218 Fax:612 436-6318 Cell: 612 743-6724

--Original Message-- From: Stecklein, Lynn [mailto:Lynn.Stecklein@qwest.com] Sent: Tuesday, January 24, 2006 11:47 AM To: Johnson, Bonnie J. Subject: SCR063003-02 Develop Test Capability in GUI

Hi Bonnie,

We are in the process of compiling all the IMA 20.0 candidates. I have a question about SCR063003-02 (Develop Test Capability in GUI to Allow Testing Before Major and Point Releases). In February of 2005, you stated that you were working through other processes to accommodate this request. Do you still want this CR to remain on the IMA 20.0 candidate list? Let me know.

Thanks!

Lynn Stecklein

Qwest Wholesale CRPM

303 382-5770

2/16/05 CMP Systems Meeting - IMA 18.0 Candidate Discussion

Bonnie Johnson-Eschelon stated that they we are working through other processes to accommodate this request. Bonnie requested that the CR remain open and that it is a low priority for Eschelon.

7/22/04 CMP Systems Meeting

Jill Martain/Qwest stated that Qwest would distribute the ballot on July 27th, it is due back to Qwest on July 30th, and Qwest would email the initial prioritization list to the CLECs on August 3rd. There were no questions. Kim Isaacs/Eschelon stated that this is a medium low for Eschelon due to the LOE and that other CRs address some of the issues as well.

3/19/04 CMP Systems Meeting

See AI021904-08 Testing Scenarios

Connie Winston/Qwest stated that we met internally and intend to meet again at the end of March. Connie said that once the internal meetings are held, we would schedule an adhoc meeting after 15.0 with the CLEC Community to discuss the testing scenarios.

2/19/04 CMP Systems Meeting

Connie Winston/Qwest discussed the 3rd item on the open issue tab of the project plan. Connie stated that we have talked off-line with Eschelon to discuss an alternative solution to SCR063002-03 Develop Test capability in GUI to allow testing before major and point releases. Connie stated that the test time is currently built into the LOE. Connie stated that we could begin by adding items the CLECs would like to see in regression testing. Connie said that we could look at examples such as blocking and hunting. Connie also stated that we could look at a small subset of scenarios and have an adhoc call to determine if the scenarios are those that the CLECs want tested. Connie stated that the tests would be marked as pass/fail and if the test does not pass, a CR would be created. Connie said that when you get this close to a release, we event notify that the release is going in with a bug. Connie said that this is not common but it does happen. Connie said that it would not be just for CLEC Test cases but all cases. Connie said that we would communicate on the CLEC Test cases if we were implementing the release with a bug Bonnie Johnson/Eschelon stated that she appreciates Qwest looking at alternative solutions to this CR. Connie Winston/Qwest stated that Qwest will schedule an adhoc call within the next two or three weeks.

8/21/03 CMP Systems Meeting

Connie Winston/Qwest stated that this request would require a GUI to mimic the SATE environment and that documentation would be updated. Connie stated that if this request is voted in, the release date will be moved out a month for the 15.0 Release because of the new process on the front end. Connie also noted that the other item around this request is that it will require quite a lot of resources to support the new environment. She stated that to support this new environment Qwest estimates that 10,500 hours would be utilized. These hours would be taken from the release hours going forward. Bonnie Johnson/Eschelon asked if Qwest currently draws from the total hours for SATE. Connie Winston/Qwest stated that the hours would be drawn from the IMA hours and the SATE hours are currently absorbed. Liz Balvin/MCI asked if the 10,500 hours is above and beyond what it would take to implement. Connie Winston/Qwest said that yes, the hours would be per release, initial implementation has it’s own LOE of 1250 to 2050 hours. Kit Thomte/Qwest asked if there were any other comments or questions. There were no other comments or questions.

Kim Isaacs/Echelon stated that this CR was the highest for them. Connie Winston/Qwest stated that the LOE for implementation was 1250 to 2050 and SATE hours of 2760 to 4600. She also stated again that the CR would require 10,500 out of every release.

7/10/03 Clarification Meeting

Introduction of Attendees Bonnie Johnson - Eschelon, Kim Isaacs - Eschelon, Sharon Van Meter - AT&T, Stephanie Prull - McLeod, Lynn Notarianni - Qwest, Pat Bratetic - Qwest, Lynn Stecklein - Qwest

Review Requested (Description of) Change Eschelon is requesting Qwest Develop test capability in the GUI to allow testing before major and point releases. Currently Qwest offers SATE testing for EDI, Qwest should offer similar testing in the IMA GUI. Pat Bratetic - Qwest asked if Eschelon could provide information on SBC's testing process. Bonnie Johnson - Eschelon stated that SBCs GUI releases are flash cuts and that they provide Eschelon the opportunity to have test data bases in LSR submission. Kim Isaacs - Eschelon stated that the GUI test window is open one month prior to the release date. Five test orders can be submitted a day. Test scenarios are developed and there is a daily conference call with your assigned point of contact during the testing period. Kim also stated that any identified defects are corrected prior to the release or there is a mutually agreed upon workaround. Kim stated that the daily calls are with individual CLECS and their assigned point of contact, not with the CLEC Community. Lynn Notarianni - Qwest asked when test cases needed to be submitted.. Kim said that the window is 1 week in advance. Pat Bratetic - Qwest asked asked if the test cases received FOCs or rejects. Kim said that test cases do receive FOCs. They do drop out of flow through and the SME in the center reviews to determine whether they could complete and process. Lynn N. asked what the process associated with defect tickets. Kim stated that the fix was done prior to the release and if there is a workaround everyone has to agree on the workaround. Lynn N. asked if a change had ever been backed out of a release and Kim said that no change was ever backed out of a release. Lynn N. said that the goal would be to keep with the schedule release. Lynn N. asked if Pre-Order and Order were impacted and Kim said yes. Lynn N. asked if this process was documented and Kim said that it is on the website as of approximately December 2000. Lynn N. asked if this was an optional and Kim said that it is optional and is similar to the EDI process. Pat B asked how many cases could be submitted per day and Kim stated that 5 per day could be sent and everything is reviewed daily.

Confirm Areas & Products Impacted It was confirmed that the interface impacted is the IMA GUI.

Identify/Confirm CLECs Expectation

Establish Action Plan Eschelon will present this CR in the August Monthly Meeting. Action item discussed in CMP Monthly Meeting- excerpt from June 19, 2003

AI050603-01 Testing in the IMA GUI (originated by Eschelon) Kit Thomte/Qwest stated that there have been some discussions and stated that a CR will need to be opened in order to change CMP language. Connie Winston/Qwest stated that a lot of time has been spent looking at this and stated that every option would be very expensive, to create a new environment. Connie stated that Qwest can offer a slightly longer window on Sunday and noted that fixes would need to be scheduled. Connie stated that Qwest does patches in the first week, when we can. Connie stated that there is a candidate in 14.0 that will create a table and should provide some relief. Connie stated that if we open the window, and put in that CR, there seems to be things we could work on that we would make the week after a release less painful. Connie stated that those are the options we could come up with without creating a new environment. Bonnie Johnson/Eschelon stated that she appreciates that it is a large effort, as Eschelon has just had a GUI upgrade with SBC. Bonnie noted that SBC does have a test environment that was very beneficial. Bonnie stated that part of the problem is with Event Notices, communication, and rejects. Bonnie stated that most things are fixed quickly. Bonnie stated that the problem in 12.0 applied a hunting edit so it would no longer accept an alpha character. Bonnie stated that this is an excellent example of people not talking to each other. Bonnie stated that for instance, HTZ is needed for circular hunting. Bonnie stated that there are cases where we got rejects using the workarounds. Bonnie stated that this is impacting to the business. Bonnie noted that the 12.0 problems did not get fixed until 13.0 and that is not acceptable. Bonnie stated that trouble ticket 56162 is because the CLECs have to mark for manual handling and then has to manually type the order. Bonnie stated that there needs to be some language around timelines, in getting defects fixed, so the CLECs don’t have to work manual processes for 6 month’s. Donna Osborne-Miller/AT&T stated that AT&T gives their support. Connie Winston/Qwest asked if details on SBC’s process could be provided, to better understand what you’re looking for. Kim Isaacs/Eschelon stated that the GUI test window is open one month prior to the release date, you develop test scenarios, and there is a daily conference call with your assigned point of contact during the testing period. Kim stated that any identified defects are corrected prior to the release or there is a mutually agreed upon workaround. Kim stated that the daily calls are with individual CLECS and their assigned point of contact, not with the CLEC Community. Sue Stott/Qwest asked if each CLEC provides test scenarios prior to the test. Kim Isaacs/Eschelon stated yes and stated that there are established dates. Kim stated that test accounts are then provided to the CLEC. Connie Winston/Qwest asked if it is a protected test environment. Kim Isaacs/Eschelon stated yes, there is a separate URL for the test database and you sign on with a test user id. Connie Winston/Qwest stated that a test environment has been discussed as a possible option because we cannot be in production environment for testing. Bonnie Johnson/Eschelon stated that it would be a large cost to Qwest, but asked if the benefits would outweigh the costs. Connie Winston/Qwest stated that Qwest can certainly look at that but it would require a CR. Bonnie Johnson/Eschelon stated that she would submit a CR. Connie Winston/Qwest stated that it would help to have the detail of what the expectations would be on a CR. Sue Stott/Qwest asked if the CLEC submits the test scenarios. Kim Isaacs/Eschelon stated yes, and stated that they have published dates as to when to submit those test scenarios, what the cutoff date is, and the date the scenarios are returned. Kim stated that the timelines are all outlined. Lynn Notarianni/Qwest asked if Eschelon could provide an idea of the volume of test scenarios. Lynn asked if it is typically a regression test, or a test of new functionality. Kim Isaacs/Eschelon stated that typically it is regression testing, but new functionality is also tested. Kim stated that there were 12 test scenarios in the past release with SBC. Connie Winston/Qwest stated that one scenario could touch several pieces of functionality. Kim Isaacs/Eschelon stated yes, that is correct. Connie Winston/Qwest stated that we would look for a systems CR to be submitted. Kit Thomte/Qwest stated that this action item would be closed upon receipt of Bonnie’s CR. There were no additional questions or comments.

CenturyLink Response

Kim Isaacs Integra

This letter is in response to CLEC Change Request number SCR063003-02, entitled “Develop test capability in GUI to allow testing before major and point releases. Currently Qwest offers SATE testing for EDI, Qwest should offer similar testing in the IMA GUI”.

CR Background: This CR was submitted in 2003 and an LOE was provided. Through the prioritization process, the CLEC community considered the CR for implementation from 2003 through 2007. In 2007, the CR was then placed into a Deferred status. In August 2012, CenturyLink requested a review of all Product/Process and System Deferred CRs to determine if the CRs were still valid. Integra requested CenturyLink recalculate the LOE for this CR. Instead, the CenturyLink SME team developed options for Integra to consider as an alternative to development of a new test database/environment for testing the IMA GUI prior to a release installation. During the March 2013 CMP meeting, CenturyLink and participating CLECs reviewed the IMA GUI test scenario options. After consideration and discussion with members of the CLEC community, Integra has chosen to consider the IMA GUI testing option to conduct the 1st Look at Production following an IMA release installation on Monday. In addition, that IMA GUI testing option will provide some capability to input test data into the 1st Look at Production environment though that functionality may not always be used.

With this agreement on the revised deliverable for this CR, CenturyLink will be developing an approach on how this deliverable can be implemented. Once the revised 1st Look approach/test data process can be agreed upon with the Integra and CLEC community, CenturyLink will send out a notification to inform the full CLEC community. If this can occur by August 2013, CenturyLink proposes that the solution become effective with the IMA Release 35.

Sincerely, Susan Lorence CenturyLink CR Project Manager

REVISED RESPONSE 8/21/03 CMP Systems Meeting

RE: SCR063003-02

Qwest has reviewed the information submitted as part of Change Request SCR063003-02. Based upon the scope of this CR as agreed to in the Clarification Meeting (held July 10, 2003) Qwest is able to provide an estimated Level of Effort (LOE) of 1250 to 2050 hours for this IMA Change Request and no SATE impacts..

At the August Systems CMP Meeting, CMP participants will be given the opportunity to comment on this Change Request and provide additional clarifications. Any clarifications and/or modifications identified at that time will be incorporated into Qwest’s further evaluation of this Change Request.

This Change Request is eligible for the IMA 15.0 Prioritization.

Sincerely, Qwest

DRAFT RESPONSE

8/14/03

RE: SCR063003-02

Qwest has reviewed the information submitted as part of AT&T's Change Request SCR063003-02. Based upon research that has been conducted following the Clarification meeting (held July, 10, 2003) Qwest is still examining the issue. Qwest will continue to research the problem and provide an updated response at the August Systems CMP Meeting.

At the August Systems CMP Meeting, CMP participants will be given the opportunity to comment on this Change Request and provide additional clarifications. Qwest is interested in the experiences of the CMP community as relates to this issue. Qwest will incorporate any feedback received into further evaluation of this Change Request.

Sincerely, Qwest