Changelog
After February 13th, 2023, the alert ID format will be updated from a numeric value to a 128-bit alphanumeric UUID for both new and existing alerts. This change affects how alerts are identified in the UI, particularly for the Active Alerts and Alert History pages.
This change may impact your webhook configuration. To avoid any potential mismatches and errors, we strongly recommend that you update the value format for alert ID in your webhook configuration.
Browser session alerts do not currently support the UUID format, and will continue to display the numeric ID.
Additionally, the new UUID value will be displayed in APIs' id field, and can be used to search for alerts in place of the current alertID field.
We have renamed "TCP Network Tests" to "Extended Network Tests" to better reflect both the current feature and future functionality.
In addition, as previously announced, the default Windows Installer (MSI package) will now include the Extended Network Tests (TCP Tests) by default. This option can be manually deselected during installations or removed with a switch. For more information on Endpoint Agent command line options, see Endpoint Agent Installation Reference.
The Endpoint API has been extended to include ASN information. Similar to the VPN data, users will now be able to get ASN information in the Agent Details and the Endpoint Test Data API endpoints.
This extension provides users with more information to, for example, identify the ISP a set of agents are connected to via the API. For more information, see the developer documentation related to Endpoint Agents and Endpoint Test Data.
New Cloud Agents have been added to the following locations:
- Kuala Lumpur, Malaysia (Telekom Malaysia)
- Kuala Lumpur, Malaysia (Telekom Malaysia) (IPv6)
- Saskatoon, Canada (Saskatel)
- Saskatoon, Canada (Saskatel) (IPv6)
- Washington, DC, USA
- Washington, DC, USA (IPv6)
- The ability to create new AppDynamics integrations and edit the existing AppDynamics integrations will no longer be available in the Alert Rules page. To create and edit the AppDynamics integration, use the Alerts > Integrations page.
With the addition of the test level setting for SSL verification introduced in October, 2022, the agent level SSL verification setting has been removed.
If your organization needs to disable SSL verification, use the Verify SSL Certificate Setting in Advanced Options on the test level.
- An issue that was preventing some embedded dashboard widgets from properly loading has been resolved.
- An issue was found where an incorrectly colored directional arrow for improving or worsening performance was displayed for some metrics in the test table widget. For example, when Response Time was increasing, an upward green arrow was displayed instead of an upward red arrow. This was caused by a bug in the UI, and has been resolved.
Installation support for Ubuntu 18.04 LTS ("Bionic") has now ended. Updated images for the ThousandEyes Virtual Appliance (TEVA), Intel NUC, Raspberry Pi 4, and Docker for Linux have been released based on Ubuntu 20.04 LTS ("Focal"). We have also updated the custom appliance generation to utilize the newest images. From January 31st, 2023 onwards, you will see failures if you attempt to deploy new agents on Ubuntu 18.04 LTS. Please ensure you are using the latest images available for new agent deployments.
As noted in our Ubuntu Linux Support Lifecycle documentation, Ubuntu 18.04 LTS ("Bionic") will enter the End of Support period on April 30th, 2023 and End of Life on June 30th, 2023. As updated images are now available, customers who are interested in using the agent cluster method to upgrade agents can do so by following the documentation available here: Replacing an Enterprise Agent Using the Agent Clustering Method.
We expect to ship a pathway for customers to perform automated in-place upgrades from Ubuntu 18.04 LTS-based appliances to Ubuntu 20.04 LTS by the end of February 2023.
Recorder IDE v1.6.0 has now been released. This release includes:
- Standalone Mode: Permissions for the ThousandEyes Recorder IDE have been expanded. Users can now generate scripts with the Recorder IDE without permission to create transaction tests or use the credentials repository. Only API Access and Login permissions are required. For more information, see ThousandEyes Recorder Permissions.
- Test Settings and the option to Export to ThousandEyes now include the following fields: Exclude Domains/Object URLs, Screenshots, Camera and Microphone, Geolocation, Page Loading Strategy, Preferred Language.
We are excited to announce the release of our first wave of Cloud Agent locations for Webex Calling. These Cloud Agents are installed inside the Webex Calling data centers around the globe, and will help you better monitor the performance of your Webex Calling environment. The following locations are now live:
- Chicago, IL, USA (Webex Calling)
- Dallas, TX, USA (Webex Calling)
- Frankfurt, Germany (Webex Calling)
- London, England (Webex Calling)
- Melbourne, Australia (Webex Calling)
- Osaka, Japan (Webex Calling)
- Sydney, Australia (Webex Calling)
- Tokyo, Japan (Webex Calling)
- Toronto, Canada (Webex Calling)
- Vancouver, Canada (Webex Calling)
Installation support for Ubuntu 18.04 LTS ("Bionic") will end on January 31st, 2023. This affects packaged agent installs, as well as image-based installations for the ThousandEyes virtual appliance, Intel NUC, and Raspberry Pi. Packages for Ubuntu 20.04 LTS ("Focal") are already available. Updated 20.04 LTS-based images for the ThousandEyes virtual appliance, Intel NUC, and Raspberry Pi are coming prior to January 31st, 2023.
As noted in our Ubuntu Linux Support Lifecycle documentation, Ubuntu 18.04 LTS ("Bionic") will enter the End of Support period on April 30th, 2023 and End of Life on June 30th, 2023. Aligned to this, we will be ceasing support for the Cisco KVM deployment images for Cisco routers running IOS-XE 16.x. We recommend that customers migrate to deploying Docker-based agents for the Cisco Application Framework. For installation instructions, see Installing Enterprise Agents on Cisco Routers with vManage.
To assist customers with upgrading their agents to Ubuntu 20.04 LTS, we will be shipping upgrade scripts with the web-based UI on ThousandEyes Virtual Appliances, Intel NUC, and Raspberry Pi. This provides a pathway for in-place upgrades. For customers who wish to upgrade using the agent clustering method, you may do so as soon as the 20.04 images become available. For more information, see Replacing an Enterprise Agent Using the Agent Clustering Method.
We have renewed the ThousandEyes SAML certificate and app.thousandeyes.com/saml-metadata now returns a new certificate. If you use a dynamic configuration for your SSO, your IdP server will automatically receive the new certificate. If you use a static or metadata-file configuration, you will need to update to the new certificate. For instructions, see ThousandEyes SAML Configuration.
This update must be completed by February 18, 2023.
If your organization continues to use the old certificate for encrypting SAML assertion, users in your organization will no longer be able to log into ThousandEyes after February 18, 2023. The single logout feature will also be impacted.
In December 2022, an adjustment was made to include Zoom Rooms in the Zoom AST. For Zoom Rooms applications running on macOS and Windows, the Endpoint Agent client will activate for AST tests. This is enabled in Endpoint Agents running 1.141 version or later. Currently, this feature is in preview status while we verify the feature with beta customers.
The Endpoint API has been extended to allow users to delete agents directly from the API. This extension provides users full control on the management of the agent via the API, by allowing customers to enable, disable, and delete any agent. For more information, see the API Documentation.
- Users can now create Endpoint Agent labels that filter for agents that are not connected to a VPN, by using the "Not In" option of the VPN Vendors filter. This allows customers that are using one of the VPN vendors supported by ThousandEyes to identify agents that are not using that VPN, and apply a different set of tests to them.
- A new metric has been added to dashboards: Page Load Completion. This allows a user to understand if a page load was successfully completed and to calculate this percentage over time.
New Cloud Agents have been added to the following locations:
- Lille, France
- Lille, France (IPv6)
- New York, NY, USA (AT&T)
- New York, NY, USA (AT&T) (IPv6)
- Rome, Italy (Telecom Italia)
- Rome, Italy (Telecom Italia) (IPv6)
- Rome, Italy (WINDTRE)
- Rome, Italy (WINDTRE) (IPv6)
- An issue that was causing inconsistent transaction marker results between the test view and dashboard has been resolved.
- An issue with the filter selection on Internet Insights dashboard widgets that was preventing users from saving inputted domains as part of the filter has been resolved.
- An issue was found that impacted the line chart dashboard widget as users went from a specific scale selection to an auto scaled selection. As users navigated between the two options, the Y Axis would disappear. This has been corrected.
We have updated several Cloud Agent locations and names for Azure, GCP, and AWS to match what they publish in their documentation. The changes are as follows, with the left hand side being the original name and the right hand side being the new name:
- Ashburn, VA (AWS us-east-1) -> N. Virginia (AWS us-east-1)
- Ashburn, VA - Oracle only (AWS us-east-1) -> N. Virginia Oracle only (AWS us-east-1)
- Ashburn, VA 2 - Oracle only (AWS us-east-1) -> N. Virginia 2 Oracle only (AWS us-east-1)
- Columbus, OH (AWS us-east-2) -> Ohio (AWS us-east-2)
- Dubai, UAE (AWS me-central-1) -> United Arab Emirates (AWS me-central-1)
- Dublin, Ireland (AWS eu-west-1) -> Ireland (AWS eu-west-1)
- Manama, Bahrain (AWS me-south-1) -> Bahrain (AWS me-south-1)
- Montreal, Canada (AWS ca-central-1) -> Central Canada (AWS ca-central-1)
- San Jose, CA (AWS us-west-1) -> N. California (AWS us-west-1)
- The Dalles, OR (AWS us-west-2) -> Oregon (AWS us-west-2)
- Amsterdam, Netherlands (Azure westeurope) -> Netherlands (Azure westeurope)
- Boydton, VA (Azure eastus2) -> Virginia (Azure eastus2)
- Cheyenne, WY (Azure westcentralus) -> Wyoming (Azure westcentralus)
- Chicago, IL (Azure northcentralus) -> Illinois (Azure northcentralus) (3 VAs affected)
- Chicago, IL - Oracle only (Azure northcentralus) -> Illinois Oracle only (Azure northcentralus)
- Chicago, IL 2 - Oracle only (Azure northcentralus) -> Illinois 2 Oracle only (Azure northcentralus)
- Des Moines, IA (Azure centralus) -> Iowa (Azure centralus)
- Dublin, Ireland (Azure northeurope) -> Ireland (Azure northeurope)
- Melbourne, Australia (Azure australiasoutheast) -> Victoria, Australia (Azure australiasoutheast)
- Phoenix, AZ (Azure westus3) -> Arizona (Azure westus3)
- Quincy, WA (Azure westus2) -> Washington (Azure westus2)
- Richmond, VA (Azure eastus) -> Virginia (Azure eastus)
- San Antonio, TX (Azure southcentralus) -> Texas (Azure southcentralus)
- Santa Clara, CA (Azure westus) -> California (Azure westus)
- Sydney, Australia (Azure australiaeast) -> New South Wales, Australia (Azure australiaeast)
- Midlothian, TX (GCP us-south1) -> Dallas, TX (GCP us-south1)
- New Albany, OH (GCP us-east5) -> Columbus, OH (GCP us-east5)
New Cloud Agents have been added to the following locations:
- Ashburn, VA, USA (Charter) (IPv6)
- Chicago, IL, USA (Comcast) (IPv6)
- Dallas, TX, USA (AT&T) (IPv6)
- Dallas, TX, USA (CenturyLink) (IPv6)
- Dallas, TX, USA (Comcast) (IPv6)
- Dallas, TX, USA (Cox) (IPv6)
- Doha, Qatar (Azure qatarcentral)
- Kuala Lumpur, Malaysia (TIME)
- Kuala Lumpur, Malaysia (TIME) (IPv6)
- Los Angeles, CA, USA (AT&T) (IPv6)
- New York, NY, USA (CenturyLink) (IPv6)
- San Jose, CA, USA (Comcast) (IPv6)
- Seattle, WA, USA (Charter) (IPv6)
- Seattle, WA, USA (Comcast) (IPv6)
- We have updated how page speed and response times are calculated for Endpoint Agent browser session tests when a page gets no response. Previously, the values shown in the page speed were not accurate, and the wait time was shown as "Response Time". This was misleading, as the browser never accessed the page. These values have now been updated to show a dash on non-responsive pages.
- The alert grid widget has now been removed from the platform and from snapshots. Customers can no longer create or view any alert grid widget in the platform.
- An issue that was preventing some BGP alerts from clearing even after the alert rule was modified and conditions were no longer met has been resolved.
- An issue that was incorrectly showing all Enterprise and Endpoint Agents as "online" in our map widget, even if some agents were offline at the time, has been resolved.
- An issue that was preventing users from duplicating existing custom webhook integrations has been resolved.
- An issue that was preventing some scheduled snapshots from being created for a short period of time has been resolved.
- An issue that was preventing a small handful of Endpoint alerts from clearing, even after all alert rules were removed from a test, has been resolved.
- An issue that was preventing users from using the Alert Rules filter on select dashboard widgets has been resolved.
- An issue that was incorrectly stating that some AppDynamics alert integrations were "Untested" even after they had been successfully tested has been resolved..
With the merging of reports functionality into ThousandEyes dashboards, the v7 Reports API is now deprecated and will be removed in January, 2023.
If your organization used v7 Reports API endpoints in the past, we recommend you now use the v7 Dashboards API. You should expect slightly different responses from the v7 Dashboards API, but full feature parity.
We have updated the ThousandEyes console and web UI for the virtual appliance as part of an ongoing effort to improve IPv6 support within the agent. These improvements include:
- When configuring DNS manually in the web UI, there are now four configuration fields, and support for adding IPv6 nameserver addresses.
- When IPv6 is set to
Auto, all relevant network information is now shown in both the console and web UI, the same as when it is set toManual. - The link-local IPv6 address is no longer shown on the network interface. Instead, only valid routable addresses will be shown if they are configured.
- It is now possible to disable IPv4 from the console directly when manually configuring networking, to support IPv6-only networks.
In addition, the following functionality has been removed:
- Two status checks in the diagnostics tool within the web UI have been removed. These are the reachability check for the ThousandEyes API and the validity check for the account group token. The reachability check is no longer needed, and the validity check has been made redundant as part of the process for submitting the token in the UI.
As more and more customers leverage our Automated Session Tests, most require the TCP network tests provided through the NPCAP library. Starting on 31 January, 2023, the MSI installation default will include TCP test support to ease installation. This consists of the NPCAP library. Endpoint Agents that have not previously been installed with the TCP tests option will not be impacted and continue with their original installation preference.
Starting on 31 January, 2023, when a new installer is downloaded, the NPCAP library, with the TCP test option, will be included by default. Customers may remove this option during installation with an MSI switch or by unselecting the option in the installer.
We are introducing a new workflow for updating or replacing a registered user's email address. Previously, a message was sent only to the new email address. With this change, if a user attempts to update their email address, a confirmation email message will be sent to both their old email address and the new email address. The email address will only be updated for a user if both email messages are confirmed.
Custom webhook security has been improved, as we now automatically mask all credential entries in the UI.
The Internet Insights catalog now includes coverage of the following SaaS providers:
- Streaming: HBO Max, Hulu, Netflix, Spotify (new category).
- Finance: Cash App, Venmo.
- Collaboration & Messaging: WhatsApp.
- Social Media & Networking: TikTok.
New Cloud Agents have been added to the following locations:
- Anchorage, AK, USA (IPv6)
- Los Angeles, CA, USA (Comcast) (IPv6)
- Pittsburgh, PA, USA (Comcast)
- Pittsburgh, PA, USA (Comcast) (IPv6)
- To further improve the usability of the new browser options settings for page load and transaction tests, new button selection and more hover over text has been added.
- The v7 API Integrations endpoints now use a string UUID for the
integrations idfield instead of a numeric ID.
- An issue that caused the virtual appliance web UI to not show the correct DNS hostname provided by the DHCP server has been resolved.
- An issue that caused the virtual appliance interfaces that were configured as “auto” / “dhcp” and assigned with no valid address to show up as 'configured' has been resolved, and they will now show as an empty value.
- An issue that was preventing BGP alerts from clearing after the alert rule was updated or removed from a test has been resolved.
After December 20, 2022, you will not be able to add new alert grid widgets to dashboards. The widget type will be removed on January 20, 2023. Existing alert grid widgets will be removed from the platform and from snapshots. ThousandEyes recommends that you replace these alert grid widgets with alert list widgets if desired.
ThousandEyes custom webhooks now support Endpoint Agent browser session alert types. You can now create custom webhooks and attach them to any Endpoint Agent browser session alert rule.
- Browser session tests from the Endpoint Agent have updated how Page Speed and Response times are calculated for pages where we get no response. Before, not fully accurate values were shown in the Page Speed and the wait time was shown as "Response Time". This was misleading because the browser never accessed to the page. These values have been updated to show a dash instead in those cases.
New Cloud Agents have been added to the following locations:
- Ashburn, VA, USA (Comcast) (IPv6)
- Ashburn, VA, USA (Verizon) (IPv6)
- Ashburn, VA, USA (AT&T) (IPv6)
- Chicago, IL, USA (CenturyLink) (IPv6)
- Chicago, IL, USA (Charter) (IPv6)
- Chicago, IL, USA (Verizon) (IPv6)
- Dallas, TX, USA (Comcast) (IPv6)
- New York, NY, USA (Comcast) (IPv6)
- San Jose, CA, USA (Charter) (IPv6)
- Endpoint Agent: An issue has been fixed in the Wireless tab of the Local Network tests in the Views section. When the user filters by Agents, the Endpoint Table is no longer incorrectly showing "No Data", and instead the results are now consistent with the BSSID Table.
- Endpoint Agent: The application of test configuration changes (e.g., changes of priority) in the Endpoint Agent has been improved and it will now take immediate action, or at last in the next check-in of the agent.
- Endpoint Agent: An issue that was showing an incorrect format for the retransmission rates in the Endpoint and BSSID tables of the Local Network tests has been resolved.
- Endpoint Agent: An issue has been fixed in the Automated Session Test (AST) widget of the Dashboard section. The filter by Target IP does now show the correct list of IPs available.
- Dashboard: Fixed an issue that was creating blank filters for some Dashboard widgets.
- Alerts: An issue that was preventing some customers in EU from assigning alert suppression windows to tests has been resolved.
- Account Management: An issue was allowing customers to create identical users in the same account. This has now been resolved, and an error is displayed, if an existing user gets created a second time.
- Revenue Platform: Fixed an issue in the usage consumption calculator that showed inaccurate unit consumption that did not match what customers saw when creating tests. This issue occurred specifically with agent-to-agent tests.
- Revenue Platform: An issue was causing a low response from the /v6/tests/#/test_update API. This has now been resolved and the previous response times have been restored.
- Browser Bot: Fixed issues related to the exclude domains feature on page load and transaction tests.
Additional advanced settings have been added for configuring page load and transaction tests:
- Exclude Domains and Object URLs: Users can now block requests to specific domains and object URLs. This excludes objects that are not important to the performance of your web page, or ensure third party tracking software is unaffected by your browser synthetic tests.
- Disable Screenshots: Users can now disable screenshots in a test.
- Set Browser Language: You can now set the browser language for your page load and transaction tests to verify the various language versions of your website or application.
- Set Page Loading Strategy: Some transaction tests have high timeouts because they need to wait for large assets to load in the browser before the next synthetic action can take place. Users can now adjust the page loading strategy so that synthetic actions are not delayed by non-critical assets. This lowers both the total necessary timeout length needed, and the variability in transaction time metrics.
- Emulate Microphone and Camera Input: This feature allows you to emulate a camera and microphone for web applications that require camera/microphone input.
- Allow Geolocation From Agent Vantage Point: This feature provides the geolocation of your agent for applications that require geolocation input.
In preparation for providing support for using IPv6 for agent communication between Enterprise Agents and the ThousandEyes Cloud, we will be adding IPv6 addresses as new AAAA records to our existing public production endpoints.
For the ThousandEyes package repositories, IPv6 will be used on platforms that preference IPv6 if you have a dual-stack configuration. For customers with proxies configured, your proxy configuration will determine whether agent traffic is sent via IPv4 or IPv6. All other agent communications are controlled by a flag in the Enterprise Agent configuration and should not be disrupted.
This change will occur on November 16th, 2022. The new IPv6 addresses can be found in our Firewall Configuration for Enterprise Agents and Static IP Addresses for ThousandEyes Repositories documentation.
ASN information is often very useful while troubleshooting a network issue. Having to look for the specific IP range related to a particular ISP always slows down all the network-related tasks. In order to make all these processes simpler, we have introduced support for ASN information in various parts of the Endpoint Agent:
- You can now filter agents by their ASN in the Agent Settings table. This way, you can identify the agents that are connecting from a specific ASN (ISP).
- Similar filtering has been added to agent labels. You can now associate a label with an ASN by searching for the AS by name or number.
- You can now filter test views by agent ASN, which lets you easily identify the test data that is specifically related to the agents associated with the ISP affected by the outage.
- Two new grouping options have been added to the Path Visualization tab. You can now group by both agent ASN and interface ASN, and identify whether an issue is related to a specific AS, as well as the affected agents.
ThousandEyes now supports configuring multiple interfaces on Cisco Catalyst devices, allowing a single Cisco Enterprise Agent to access multiple virtual networks, instead of deploying separate agents for each virtual network. This will benefit the SD-WAN users who want to measure performance across each WAN circuit.
For more information on multi-interface support, see Multi-Interface Support for Cisco Catalyst 9000 Switches.
ThousandEyes has updated its content subscription categories for product documentation. All existing subscriptions will be transferred to the new categories, and no action is required from customers.
The new categories are:
- New ThousandEyes Documentation
- Release Notes
- Privacy and Security
New Cloud Agents have been added to the following locations:
- Ahmedabad, India (Vodafone Idea)
- Ahmedabad, India (Vodafone Idea) (IPv6)
- Ashburn, VA (Cox) (IPv6)
- Ashburn, VA (CenturyLink) (IPv6)
- Chicago, IL (Cox) (IPv6)
- Los Angeles, CA (Cox) (IPv6)
- Paris, France (Orange)
- Paris, France (Orange) (IPv6)
- Seattle, WA (CenturyLink) (IPv6)
- An issue that caused certain hover panels in Internet Insights to display beyond the edge of the screen has been resolved.
- Cloud and Enterprise Agents: Fixed an issue where agent proxy information was displayed incorrectly in Views when a proxy is not used.
- Cloud and Enterprise Agents: Fixed an issue in the API that prevented the contentRegex property from being reset to empty in an HTTP server test.
- Dashboard: Fixed an issue where the Color Grid widget was using the wrong scale colors for Endpoint Agent automated session tests.
- Enterprise Agents: An issue that prevented custom appliances from detecting network interfaces in NUC11 physical appliances has been resolved.
- Revenue Platform: Fixed an issue in the usage consumption calculator that showed inaccurate unit consumption that did not match what users saw when creating tests. This issue occurred specifically with agent-to-agent tests.
- Fixed an issue where alerts were triggered incorrectly during an active alert suppression window.
- An issue has been resolved that impacted the reliability of NAT traversal while executing agent-to-agent tests against Webex Cloud Agents.
Automated session test data can now be used to generate dashboards. In particular, you can now use the data from both Network (Jitter, Loss, Latency, TCP Connection Count, VPN Loss, VPN Latency) and System (CPU and Memory Load) metrics together with the standard measures (Mean, Median, Average, Maximum, Minimum, nth Percentile, and Standard Deviation).
AST data is only available in the Grouped Bar, Table, Multimetric table, Number, Color Grid, Line, and Box and Whiskers widgets.
Endpoint Agent Views, the screen that shows all the results related to Endpoint Agent tests, has been improved in order to make troubleshooting tasks easier:
- The type of connection (Ethernet/Wireless), SSID and channel information has been added to the table of the Network tabs for scheduled and automated session tests. This way, you can easily correlate issues related to the quality of the wireless connection.
- We have added a new filter option on the Views page that allows users to define a filter for different network metrics (i.e., jitter, latency, packet loss, VPN latency, and VPN packet loss) to, for example, identify all the agents with latency over a threshold. This aims to make the identification of agents affected by a specific metric easier.
-
Two new buttons have been added to the Network > Table tab to help you in your troubleshooting workflow. Previously, the Network > Table tab helped you to identify the set of agents that were affected by a specific issue, but you could not easily select and filter them to focus on the data related to the affected agents. Now, with the addition of these two buttons, you can easily select agents and automatically create a filter for the whole view or specifically for the pathview.
- A new grouping option has been added to the Table tab for automated session tests. Unlike other types of tests, a single automated session test might target many different destinations (IP addresses) within the same test (Webex). To make the identification of the specific destinations affected by an incident easier, we now provide the ability to group tests by agent and also by agent and IP addresses.
You can now create, edit, and manage dashboards via a labeling system. You can create custom labels and assign them to specific dashboards, either via the dashboard selector or via the Dashboard Details page for a specific dashboard. You can then filter based on the created labels when using the dashboard selector for easy access to you favorite dashboards.
- We have slightly changed the behavior of our custom webhook testing functionality. Previously, the Test Status of an integration would not change from Success to Untested if a user made a change to an existing webhook that had successfully been tested. Now, if a user makes a change to the custom webhook form, except for changing the name of the webhook, the status will be changed to Untested until a user again successfully tests the integration.
New Cloud Agents have been added to the following locations:
- Chennai, India (Bharti Airtel)
- Chennai, India (Bharti Airtel) (IPv6)
- Kazan, Russia
- Kazan, Russia (IPv6)
- Los Angeles, CA, USA (CenturyLink) (IPv6)
- Los Angeles, CA, USA (Charter) (IPv6)
- New Delhi, India (Bharti Airtel)
- New Delhi, India (Bharti Airtel) (IPv6)
- San Jose, CA, USA (CenturyLink) (IPv6)
- San Jose, CA, USA (Cox) (IPv6)
- Sendai, Japan (IPv6)
- St. John's, Canada
- St. John's, Canada (IPv6)
- An issue, where the user API was sometimes incorrectly throwing a 4xx response when attempting to add a new user to an organization, has been resolved. This occurred when a user already existed in a different organization and was being added to a new organization. The user was still correctly being added, but our API was sending an incorrect response.
Reports and dashboards have now been merged into a single function. Reports has been removed from our lefthand navigation and all functionality has been consolidated into our Dashboards page. To find your previous reports, you can filter in the dashboard selector on Migrated Reports.
The Endpoint Agent View dashboard has been enhanced in order to make troubleshooting easier. These updates include:
- Improvements have been made to the search function for agents. In addition to agent name, you can now search by username, hostname, and IP addresses (both public and private).
- The tooltip for wireless information within the Network Access row will now show all the information related to the wireless information (i.e., SSID, Channel, Phy Mode) to make it easier to correlate data when troubleshooting issues related to it.
We have improved how our v6 and v7 dashboard APIs work as it relates to the time range specified in the API request. If the user provides a time range (from and to) in their API request to get widget data, the API will now return data for that time range. If the user does not provide a time range in the API request, the request will use the dashboard's defaultTimespan if globalOverride is set to true. If globalOverride is set to false, then the API will return data for the individual widget time settings set by the user or the default time range (1 day) if no value is set for the individual widget. The user can change defaultTimespan and globalOverride values using the UI or the dashboardupdate endpoint of the v7 API.
Our custom webhooks now support Endpoint Scheduled Test alert types. You can now create custom webhooks and attach them to any Endpoint Scheduled Test alert rule. We have also improved the Alert Rules page under Alerts. As we continue to scale out the types of alert rules supported, we have added a specific alert type group selector when assigning alert rules for an integration.
New Cloud Agents have been added to the following locations:
- Ahmedabad, India (Bharti Airtel)
- Ahmedabad, India (Bharti Airtel) (IPv6)
- Chicago, IL, USA (IPv6)
- Dubai, UAE (AWS me-central-1)
- Jakarta, Indonesia (IPv6)
- Kazan, Russia
- kazan, Russia (IPv6)
- Lagos, Nigeria (IPv6)
- New Delhi, India (Vodafone Idea)
- New Delhi, India (Vodafone Idea) (IPv6)
- St. John's, Canada
- St. John's, Canada (IPv6)
- Yogyakarta, Indonesia
- Yogyakarta, Indonesia (IPv6)
- Device Discovery now correctly shows an error message when a newly discovered device is a duplicate of a monitored device.
- An issue that caused the browser back button to not work as expected on the Internet Insights Overview page has been resolved.
- An alert rules issue for Devices, that prevented the interface selection dropdown from correctly appearing in account groups with large numbers of monitored interfaces, has been resolved.
- An issue that was temporarily preventing our EU region customers from accessing the "Integrations" page in product has been resolved.
In Cloud & Enterprise Agents > Test Settings > Advanced Settings, the Verify SSL certificate field now applies to both the HTTP view and the page load or transaction view in page load and transaction tests.
Previously, the Verify SSL certificate setting for these test types did not apply for the entire test, but held for the HTTP server view only. As a workaround, customers had to configure the agent-level settings.
As part of this change, starting December 6, 2022, we will begin phasing out support of the agent-level option at Cloud & Enterprise Agents > Enterprise Agents > Agent Settings > agent-name > Verify SSL certificates for browser tests.
In cases where the test-level option is de-selected but the agent-level option is not de-selected, the ThousandEyes platform will continue to apply the agent-level setting until December 6, 2022.
After that date, all web-layer tests will follow the configuration you have set in Test Settings. The agent-level setting will be removed.
Most browser-based tests will not require changes. But if your page load and transaction tests have SSL verification disabled, review your configuration and use the test-level setting going forward.
New Cloud Agents have been added to the following locations:
- Anchorage, AK, USA
- Cleveland, OH, USA
- Cleveland, OH, USA (IPv6)
- Cleveland, OH, USA (Charter)
- Cleveland, OH, USA (Charter) (IPv6)
- Surabaya, Indonesia
- Surabaya, Indonesia (IPv6)
In addition, we've added AWS Cloud Agents in the locations listed below. For a full list of Cloud Agents, see ThousandEyes Cloud Agent Locations.
- Boston, MA, USA (AWS Local Zone) (AWS us-east-1-bos-1)
- Chicago, IL, USA (AWS Local Zone) (AWS us-east-1-chi-1)
- Dallas, TX, USA (AWS Local Zone) (AWS us-east-1-dfw-1)
- Denver, CO, USA (AWS Local Zone) (AWS us-west-2-den-1)
- Houston, TX, USA (AWS Local Zone) (AWS us-east-1-iah-1)
- Kansas City, MO, USA (AWS Local Zone) (AWS us-east-1-mci-1)
- Las Vegas, NV, USA (AWS Local Zone) (AWS us-west-2-las-1)
- Los Angeles, CA, USA (AWS Local Zone) (AWS us-west-2-lax-1)
- Miami, FL, USA (AWS Local Zone) (AWS us-east-1-mia-1)
- Minneapolis, MN, USA (AWS Local Zone) (AWS us-east-1-msp-1)
- New York, NY, USA (AWS Local Zone) (AWS us-east-1-nyc-1)
- Philadelphia, PA, USA (AWS Local Zone) (AWS us-east-1-phl-1)
- Phoenix, AZ, USA (AWS Local Zone) (AWS us-west-2-pdx-1)
- An issue was fixed in the Update Tests API that prevented updating the port in agent-to-server tests if the server wasn't also specified.
- An issue was resolved that was preventing some dashboards from automatically updating every two minutes.
Customers can now generate snapshots for multi-service views they have configured. For more information on multi-service views, see Multi-Service Views.
The Recorder IDE and all Cloud and Enterprise Agents with auto-updates have been upgraded to use Chromium 97 with BrowserBot (v2.6.0+) and Recorder IDE v1.4.0.
Between Chromium v80 (BrowserBot v2.5.9 and prior) and Chromium v97, notable differences include:
- Recorder IDE stability on macOS devices.
- After an iframe is destroyed, Selenium WebDriver will no longer switch to the default content automatically.
- HTML elements with an area of zero are no longer clickable.
- shadowRoot no longer returns a WebElement.
- ChromeDriver does not wait for the HTML document to be loaded completely.
The upgrade to the NPCAP library on the Endpoint Agent client for Windows will now be done on September 28, 2022, and not on September 17, 2022, as communicated previously.
The ThousandEyes Support chat has been replaced by the new chatbot service, TEACH (ThousandEyes Assistant, Concierge, & Helper). For more information about TEACH, see Live Chat.
New Cloud Agents have been added to the following locations:
- Bangalore, India (Bharti Airtel)
- Bangalore, India (Bharti Airtel) (IPv6)
- Bangalore, India (Vodafone Idea)
- Bangalore, India (Vodafone Idea) (IPv6)
- Chennai, India (Vodafone Idea)
- Chennai, India (Vodafone Idea) (IPv6)
- Mumbai, India (Bharti Airtel)
- Mumbai, India (Bharti Airtel) (IPV6)
- Northampton, England (IPv6)
- An issue that caused edited dashboards to not save correctly after a refresh has been resolved.
- An issue that prevented refresh tokens from being generated for oAuth client credential authentication in custom webhooks has been fixed.
- An issue has been resolved where the filter options were not populating correctly on our live status widgets for dashboards.
- An issue that was causing reports in Japanese that were downloaded in PDF to be formatted incorrectly has been resolved.
- An issue was found where several group by options for our Endpoint Agent report and dashboard widgets were not available. This has now been corrected. The list of missing group bys were as follows:
- Gateway
- SSID
- BSSID
- VPN Vendor
- VPN Gateway
- Proxy Address
- DNS Server
- Session Errors
- IP Address
- An issue that was incorrectly triggering dynamic baseline alerts that had multiple dynamic alert conditions attached to it, whether in the same rule or in multiple different rules, has been resolved.
- An issue was identified where timestamps for individual schedule HTTP server tests in the Endpoint Agent were not taking into account the user's timezone. This has been resolved, and you will now see the correct timestamps associated to each test taking into account the specific timezone.
We are happy to announce general availability of our new custom webhooks feature! You can find custom webhooks under the Alerts > Integrations menu. With custom webhooks, you can
- Ingest our alert webhook into any third-party system that supports incoming webhooks, including Cisco Webex, Microsoft Teams, and Splunk.
- Define the structure of the webhook payload to your liking, including fully customizable headers, URL query parameters, and JSON payload.
- Add static key : value pairs or dynamic variables based on your needs to any portion of the webhook payload.
This feature is currently available only for our Cloud and Enterprise Agent alerts and only supported via the ThousandEyes UI. API and additional alert type support will come in the near future. You can read more about this feature in our documentation.
BrowserBot v2.6.0+ provides an upgrade to the Chrome browser used in the BrowserBot agent to run page load and transaction tests.
With the conclusion of the BrowserBot Early Track Program, all BrowserBot agents are being upgraded to v2.6+ with Chromium v97, quickly followed by an upgrade to the Recorder IDE. This change will improve IDE stability for macOS devices, and will enable additional features for browser tests from Chrome.
We've identified 3 edge cases where the scripting syntax has changed between Chromium v80 (prior to BrowserBot v2.6.0) and Chromium v97 (BrowserBot v2.6.0 and after):
- After an iframe is destroyed, Selenium WebDriver will no longer switch to the default content automatically.
- HTML elements with an area of zero are no longer clickable.
- shadowRoot no longer returns a WebElement.
We have reached out to all identified customers affected by these script changes. Contact ThousandEyes Support if you need additional assistance.
Over the next few months, we will be removing access to public snapshots that were made available via link sharing and that have not been accessed in over 365 days. This is part of our broader strategy to ensure a strong security posture for our customers. You will still be able to access these snapshots in the ThousandEyes platform, just not via the publicly accessible URL. After this change, these snapshots will be accessible as private snapshots, under Sharing > Saved Events.
We also plan to eventually delete any public snapshots that have not been accessed in 365 days entirely from the platform. If you don't want public snapshots affected by this change to be auto-deleted, you should access them to reset the time count since last access.
Both of these changes will impact all test snapshots, Endpoint Agent snapshots, Internet Insights snapshots, device snapshots, and report snapshots that have link sharing enabled and are available via a public URL. There is no action required on your part. In the future, we will introduce the option for you to define, at the time of snapshot creation, how long you want the snapshot to be active.
The new auto-detect feature, currently in open Beta, now provides full support for all AST applications (i.e,. Webex, Zoom, and MS Teams).
Auto-detect is a new feature that allows you to automatically select the best configuration to monitor the selected application in ASTs, making the monitoring of applications with your Endpoint Agents much easier.
When configuring an automated session test within the Endpoint Agents > Tests Settings dashboard, you will now see an auto-detect option under Protocol, which will automatically select the most reachable protocol for the selected application.
In order for auto-detect configuration to work correctly, you must have the TCP driver installed.
We've made a change in how we rebalance tests in agent clusters when round-robin is enabled, to take into account test sub-intervals. This change improves the reliability of round-robin enabled tests and improves balancing of tests across agent clusters.
New Cloud Agents have been added to the following locations:
- Cordoba, Argentina (IPv6)
- Osaka, Japan (KDDI) (IPv4)
- Oskaka, Japan (KDDI) (IPv6)
- Seoul, South Korea (LG Telecom)
- Singapore (Singtel)
- Singapore (Singtel) (IPv6)
- An issue that affects agent-to-agent tests conducted from the ThousandEyes Virtual Appliance (TEVA) in environments where the originating agent has IPv6 disabled in the kernel has been resolved. This issue would have impacted any TEVAs deployed that had IPv6 disabled in the kernel at boot-time, but would not have impacted TEVAs that had no IPv6 interface available, where a fallback would have already occurred.
- We have added validation to both our classic and custom webhooks that prevents users from sending webhooks to private IP addresses.
All BrowserBot agents with auto-upgrade enabled have been upgraded to version 2.5.7+ to leverage the new BrowserBot containerized architecture that uses Podman. This improves security and sets the foundation for future browser test capabilities.
As mentioned in the November 2021 Release Notes, the keep browser cache between tests option has been removed, and these page load and transaction tests will reset the browser cache between all browser test rounds. This option is no longer available from the Agent Settings page, in BrowserBot starting from v2, and is no longer functional via the API.
Amazon Linux 2 will also no longer be supported by BrowserBot starting with v2 onwards.
We have added several new features to our dashboard page in order to ensure parity between our dashboard and reports objects, with the goal of de-commissioning our reports page entirely in 30 days. All of your existing reports will now be available in the dashboard page and we strongly encourage you to stop using reports and only use dashboards moving forward.
For parity's sake, with our dashboards, you can now:
- 1.Download your dashboard and widget data into a CSV or as a PDF.
- 2.Create or schedule a snapshot of your dashboards.
- 3.Save an individual widget as an image.
- 4.Add a detailed description to a dashboard in the administration page of the dashboard.
- 5.View and edit all of your existing reports in the dashboard page.
We have also added a few new features as we work towards merging the two objects:
- 1.We have updated our dashboard selector to now match the look and feel of our test selector. You can better filter based on sharing permissions and built-in dashboards.
- 2.You can now override the individual widget time selections and apply a consistent time selection to all widgets in a dashboard.
- 3.We have added a spinning timer to let you know when your data will be refreshed.
Note that the live action dashboard widgets (alert list, alert grid, test table, and agent status) cannot be viewed in a fixed timespan. Additionally, the test table widget will always only display data on a 12-hour running period, the alert grid widget will always only show data on a 24-hour running period, and the agent status widget will always show a live status of the agents displayed.
Previously, when you reinstalled an Endpoint Agent on a device, the agent was registered as an entirely new agent in ThousandEyes. As a result, apart from perhaps seeing agents with duplicate names, you also had their data disjointed between the new and the old agent, making it very difficult to correlate the historical data between them.
With the new reinstallation key included in the agent installation process, ThousandEyes will automatically check whether there is an existing agent with the same hostname, and consolidate their data into a single one. The detailed reinstallation procedure can be found here.
The Endpoint API now includes all the agent interfaces' information in the Endpoint Agent API endpoints. In particular, you can now obtain all the available information that ThousandEyes has about the agent interfaces (for example, interface name, IP address, gateway, link speed, BSSID, SSID, and PHY mode).
New Cloud Agents have been added to the following locations:
- Liege, Belgium (Proximus)
- Liege, Belgium (Proximus) (IPv6)
- Mumbai, India (Vodafone Idea)
- Mumbai, India (Vodafone Idea) (IPv6)