Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Unsupported type for timedelta days component in snuba-consumer #2780

Closed
pierresebastien opened this issue Jun 2, 2022 · 7 comments · Fixed by #2809
Closed

Unsupported type for timedelta days component in snuba-consumer #2780

pierresebastien opened this issue Jun 2, 2022 · 7 comments · Fixed by #2809
Labels
bug Something isn't working

Comments

@pierresebastien
Copy link

Environment

How do you use Sentry?
self-hosted/on-premise (22.5.0)

Steps to Reproduce

Upgrade sentry from 22.4.0 to 22.5.0

Expected Result

snuba-consumer to process events without errors

Actual Result

snuba-consumer is unable to process because it crash at startup

2022-06-02 19:19:29,992 Consumer Starting
2022-06-02 19:19:29,993 librdkafka log level: 6
2022-06-02 19:19:32,800 New partitions assigned: {Partition(topic=Topic(name='events'), index=0): 2082906}
2022-06-02 19:19:32,802 Caught TypeError('unsupported type for timedelta days component: str'), shutting down...
2022-06-02 19:19:32,802 Closing <snuba.utils.streams.kafka_consumer_with_commit_log.KafkaConsumerWithCommitLog object at 0x7fec0f842a00>...
2022-06-02 19:19:32,803 Partitions revoked: [Partition(topic=Topic(name='events'), index=0)]
2022-06-02 19:19:32,803 Processor terminated
Traceback (most recent call last):
  File "/usr/local/bin/snuba", line 33, in <module>
    sys.exit(load_entry_point('snuba', 'console_scripts', 'snuba')())
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1128, in __call__
    return self.main(*args, **kwargs)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1053, in main
    rv = self.invoke(ctx)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1659, in invoke
    return _process_result(sub_ctx.command.invoke(sub_ctx))
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 1395, in invoke
    return ctx.invoke(self.callback, **ctx.params)
  File "/usr/local/lib/python3.8/site-packages/click/core.py", line 754, in invoke
    return __callback(*args, **kwargs)
  File "/usr/src/snuba/snuba/cli/consumer.py", line 188, in consumer
    consumer.run()
  File "/usr/local/lib/python3.8/site-packages/arroyo/processing/processor.py", line 121, in run
    self._run_once()
  File "/usr/local/lib/python3.8/site-packages/arroyo/processing/processor.py", line 159, in _run_once
    self.__processing_strategy.submit(self.__message)
  File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/streaming/filter.py", line 32, in submit
    self.__next_step.submit(message)
  File "/usr/local/lib/python3.8/site-packages/arroyo/processing/strategies/streaming/transform.py", line 72, in submit
    self.__transform_function(message),
  File "/usr/src/snuba/snuba/consumers/consumer.py", line 607, in process_message
    result = processor.process_message(
  File "/usr/src/snuba/snuba/datasets/events_processor_base.py", line 178, in process_message
    row = self.process_insert(event, metadata)
  File "/usr/src/snuba/snuba/datasets/events_processor_base.py", line 201, in process_insert
    processed["retention_days"] = override_and_enforce_retention(
  File "/usr/src/snuba/snuba/datasets/events_format.py", line 113, in override_and_enforce_retention
    return enforce_retention(retention_days, timestamp)
  File "/usr/src/snuba/snuba/datasets/events_format.py", line 137, in enforce_retention
    datetime.utcnow() - timedelta(days=retention_days)
TypeError: unsupported type for timedelta days component: str
@pierresebastien pierresebastien changed the title Unsupported type for timedelta days component in snuba-onsumer Unsupported type for timedelta days component in snuba-consumer Jun 2, 2022
@nikhars
Copy link
Member

nikhars commented Jun 2, 2022

Hi @pierresebastien Could you provide the message which is being processed by the consumer. Feel free to redact any sensitive information as needed. You could use the following command to retrieve the message or use kafka-cat or kcat
kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic events

@pierresebastien
Copy link
Author

Hello, I execute the following command in the kafka container :

root@e2f9e198454b:/# kafka-console-consumer --bootstrap-server localhost:9092 --topic events

Then I generate an error in one of our applications tracked in Sentry and I had the following output (I replaced the domain and IP by dummy values):

[
    2,
    "insert",
    {
        "group_id": 232,
        "event_id": "429b37d852ce4b32a5d60ef0d0ffa502",
        "organization_id": 1,
        "project_id": 19,
        "message": "Error while executing GET request on MVC Page: 'http://dummy.domain.com/wp-login.php', UserAgent: 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0' Instance with name 'wp-login.php' not found DepFac.ProPilot.Core.Exceptions.NotFoundException GetInstanceByName False DepFac.ProPilot.Core.Global.Repositories.InstanceRepository in GetInstanceByName",
        "platform": "csharp",
        "datetime": "2022-06-03T08:19:52.112150Z",
        "data": {
            "event_id": "429b37d852ce4b32a5d60ef0d0ffa502",
            "level": "error",
            "version": "7",
            "type": "error",
            "logentry": {
                "formatted": "Error while executing GET request on MVC Page: 'http://dummy.domain.com/wp-login.php', UserAgent: 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0'",
                "message": null,
                "params": null
            },
            "logger": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
            "modules": {
                "ASK.ServEasy": "4.0.1.0",
                "ASK.ServEasy.Windows": "4.0.1.0",
                "AjaxMin": "5.14.5506.26196",
                "AntiXssLibrary": "4.3.0.0",
                "App_Web_2332hona": "0.0.0.0",
                "App_Web_amvgtgl2": "0.0.0.0",
                "App_Web_frs2jr1v": "0.0.0.0",
                "App_Web_iousqpvw": "0.0.0.0",
                "App_global.asax.qeeq7hzx": "0.0.0.0",
                "Atlassian.Jira": "11.2.0.0",
                "Autofac": "4.0.1.0",
                "Autofac.Integration.Mvc": "4.0.0.0",
                "Autofac.Integration.Mvc.Owin": "4.0.0.0",
                "Autofac.Integration.Owin": "4.2.0.0",
                "Autofac.Integration.WebApi": "4.3.1.0",
                "Autofac.Integration.WebApi.Owin": "4.0.0.0",
                "BouncyCastle": "1.8.5811.20889",
                "CommonMark": "0.1.0.0",
                "CookComputing.XmlRpcV2": "2.5.0.0",
                "DataAnnotationsExtensions": "1.1.0.0",
                "DataAnnotationsExtensions.ClientValidation": "1.1.0.0",
                "DepFac.ProPilot.ASP": "3.20.10.0",
                "DepFac.ProPilot.ASP.Common": "3.20.10.0",
                "DepFac.ProPilot.Client": "1.0.0.0",
                "DepFac.ProPilot.Core": "3.20.10.0",
                "DepFac.ProPilot.ExtractReader": "1.1.63.0",
                "DotLiquid": "1.8.0.0",
                "DotNetZip": "1.15.0.0",
                "EPPlus": "4.1.0.0",
                "EntityFramework": "6.0.0.0",
                "EntityFramework.SqlServer": "6.0.0.0",
                "HtmlAgilityPack": "1.4.9.0",
                "ICSharpCode.SharpZipLib": "0.86.0.518",
                "IdentityModel": "1.0.0.0",
                "IdentityServer3": "2.6.0.0",
                "IdentityServer3.AccessTokenValidation": "1.0.0.0",
                "Ionic.Zip": "1.9.1.8",
                "Lucene.Net": "3.0.3.0",
                "MailKit": "1.2.0.0",
                "Microsoft.Build.Framework": "4.0.0.0",
                "Microsoft.Build.Utilities.v4.0": "4.0.0.0",
                "Microsoft.CSharp": "4.0.0.0",
                "Microsoft.IdentityModel.JsonWebTokens": "6.8.0.0",
                "Microsoft.IdentityModel.Logging": "6.8.0.0",
                "Microsoft.IdentityModel.Protocol.Extensions": "1.0.40306.1554",
                "Microsoft.IdentityModel.Protocols": "6.8.0.0",
                "Microsoft.IdentityModel.Protocols.OpenIdConnect": "6.8.0.0",
                "Microsoft.IdentityModel.Tokens": "6.8.0.0",
                "Microsoft.JScript": "10.0.0.0",
                "Microsoft.Owin": "4.1.1.0",
                "Microsoft.Owin.Host.SystemWeb": "4.1.1.0",
                "Microsoft.Owin.Security": "4.1.1.0",
                "Microsoft.Owin.Security.Cookies": "4.1.1.0",
                "Microsoft.Owin.Security.Jwt": "4.1.1.0",
                "Microsoft.Owin.Security.OAuth": "4.1.1.0",
                "Microsoft.Owin.Security.OpenIdConnect": "4.1.1.0",
                "Microsoft.VisualBasic.Activities.Compiler": "10.0.0.0",
                "Microsoft.Web.Infrastructure": "1.0.0.0",
                "MimeKit": "1.2.0.0",
                "MiniProfiler": "3.1.1.140",
                "Mono.Cecil": "0.9.5.0",
                "Mono.Cecil.Rocks": "0.9.5.0",
                "Mono.Security": "2.0.0.0",
                "MySql.Data": "6.9.6.0",
                "NCrontab": "3.3.1.0",
                "Newtonsoft.Json": "12.0.0.0",
                "NotFoundMvc": "1.2.0.0",
                "Npgsql": "2.0.11.0",
                "Owin": "1.0.0.0",
                "PagedList": "1.17.0.0",
                "PagedList.Mvc": "4.5.0.0",
                "RestSharp": "106.2.2.0",
                "SMDiagnostics": "4.0.0.0",
                "Sentry": "2.1.8.0",
                "Sentry.Log4Net": "2.1.8.0",
                "Sentry.PlatformAbstractions": "1.1.1.0",
                "Sentry.Protocol": "2.1.8.0",
                "ServiceStack": "3.9.71.0",
                "ServiceStack.Common": "3.9.71.0",
                "ServiceStack.FluentValidation.Mvc3": "3.9.71.0",
                "ServiceStack.Interfaces": "1.0.0.0",
                "ServiceStack.OrmLite": "3.9.71.0",
                "ServiceStack.OrmLite.MySql": "3.9.71.0",
                "ServiceStack.OrmLite.PostgreSQL": "3.9.71.0",
                "ServiceStack.OrmLite.SqlServer": "3.9.71.0",
                "ServiceStack.OrmLite.SqliteNET": "3.9.71.0",
                "ServiceStack.Redis": "3.9.71.0",
                "ServiceStack.ServiceInterface": "3.9.71.0",
                "ServiceStack.Text": "3.9.71.0",
                "System": "4.0.0.0",
                "System.Activities": "4.0.0.0",
                "System.ComponentModel.DataAnnotations": "4.0.0.0",
                "System.Configuration": "4.0.0.0",
                "System.Configuration.Install": "4.0.0.0",
                "System.Core": "4.0.0.0",
                "System.Data": "4.0.0.0",
                "System.Data.DataSetExtensions": "4.0.0.0",
                "System.Data.Entity": "4.0.0.0",
                "System.Data.Linq": "4.0.0.0",
                "System.Data.SQLite": "1.0.96.0",
                "System.Data.SQLite.EF6": "1.0.113.0",
                "System.Data.SQLite.Linq": "1.0.113.0",
                "System.Data.SqlXml": "4.0.0.0",
                "System.Design": "4.0.0.0",
                "System.Drawing": "4.0.0.0",
                "System.Dynamic": "4.0.0.0",
                "System.EnterpriseServices": "4.0.0.0",
                "System.IdentityModel": "4.0.0.0",
                "System.IdentityModel.Tokens.Jwt": "6.8.0.0",
                "System.Json": "4.0.0.0",
                "System.Management": "4.0.0.0",
                "System.Net.Http": "4.0.0.0",
                "System.Net.Http.Formatting": "5.2.7.0",
                "System.Numerics": "4.0.0.0",
                "System.Runtime.Caching": "4.0.0.0",
                "System.Runtime.DurableInstancing": "4.0.0.0",
                "System.Runtime.InteropServices.RuntimeInformation": "4.0.0.0",
                "System.Runtime.Serialization": "4.0.0.0",
                "System.Security": "4.0.0.0",
                "System.ServiceModel": "4.0.0.0",
                "System.ServiceModel.Activation": "4.0.0.0",
                "System.ServiceModel.Activities": "4.0.0.0",
                "System.ServiceModel.Internals": "4.0.0.0",
                "System.ServiceModel.Web": "4.0.0.0",
                "System.ServiceProcess": "4.0.0.0",
                "System.Transactions": "4.0.0.0",
                "System.Web": "4.0.0.0",
                "System.Web.Abstractions": "4.0.0.0",
                "System.Web.ApplicationServices": "4.0.0.0",
                "System.Web.Cors": "5.2.7.0",
                "System.Web.DataVisualization": "4.0.0.0",
                "System.Web.DynamicData": "4.0.0.0",
                "System.Web.Extensions": "4.0.0.0",
                "System.Web.Helpers": "3.0.0.0",
                "System.Web.Http": "5.2.7.0",
                "System.Web.Http.Cors": "5.2.7.0",
                "System.Web.Http.Owin": "5.2.7.0",
                "System.Web.Http.WebHost": "5.2.7.0",
                "System.Web.Mobile": "4.0.0.0",
                "System.Web.Mvc": "5.2.7.0",
                "System.Web.Razor": "3.0.0.0",
                "System.Web.RegularExpressions": "4.0.0.0",
                "System.Web.Services": "4.0.0.0",
                "System.Web.WebPages": "3.0.0.0",
                "System.Web.WebPages.Deployment": "3.0.0.0",
                "System.Web.WebPages.Razor": "3.0.0.0",
                "System.Windows.Forms": "4.0.0.0",
                "System.Workflow.Activities": "4.0.0.0",
                "System.Workflow.ComponentModel": "4.0.0.0",
                "System.Workflow.Runtime": "4.0.0.0",
                "System.WorkflowServices": "4.0.0.0",
                "System.Xaml": "4.0.0.0",
                "System.Xaml.Hosting": "4.0.0.0",
                "System.Xml": "4.0.0.0",
                "System.Xml.Linq": "4.0.0.0",
                "Thinktecture.IdentityModel.Client.Net45": "1.0.0.0",
                "Weavers": "1.0.0.0",
                "WebActivator": "1.5.3.0",
                "WeifenLuo.WinFormsUI.Docking": "2.9.0.0",
                "dFakto.Tools": "2.0.13.0",
                "dFakto.Tools.Excel": "2.0.13.0",
                "hbehr.recaptcha": "1.1.0.0",
                "log4net": "2.0.12.0",
                "mscorlib": "4.0.0.0",
                "netstandard": "2.0.0.0"
            },
            "platform": "csharp",
            "timestamp": 1654244392.11215,
            "received": 1654244392.139693,
            "release": "[email protected]",
            "environment": "Acceptance",
            "request": {
                "url": "http://dummy.domain.com/wp-login.php",
                "method": "GET",
                "headers": [
                    [
                        "Accept",
                        "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8"
                    ],
                    [
                        "Accept-Encoding",
                        "gzip, deflate, br"
                    ],
                    [
                        "Accept-Language",
                        "en-US,en;q=0.5"
                    ],
                    [
                        "Connection",
                        "close"
                    ],
                    [
                        "Host",
                        "dummy.domain.com"
                    ],
                    [
                        "Sec-Fetch-Dest",
                        "document"
                    ],
                    [
                        "Sec-Fetch-Mode",
                        "navigate"
                    ],
                    [
                        "Sec-Fetch-Site",
                        "none"
                    ],
                    [
                        "Sec-Fetch-User",
                        "?1"
                    ],
                    [
                        "Upgrade-Insecure-Requests",
                        "1"
                    ],
                    [
                        "User-Agent",
                        "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0"
                    ],
                    [
                        "X-Forwarded-For",
                        "0.0.0.0"
                    ],
                    [
                        "X-Forwarded-Proto",
                        "https"
                    ],
                    [
                        "X-Real-IP",
                        "0.0.0.0"
                    ]
                ],
                "query_string": [],
                "fragment": null,
                "cookies": null,
                "data": null,
                "env": null,
                "inferred_content_type": null
            },
            "contexts": {
                "CurrentCulture": {
                    "Calendar": "GregorianCalendar",
                    "DisplayName": "English (United States)",
                    "Name": "en-US",
                    "type": "CurrentCulture"
                },
                "CurrentUICulture": {
                    "Calendar": "GregorianCalendar",
                    "DisplayName": "English (United States)",
                    "Name": "en-US",
                    "type": "CurrentUICulture"
                },
                "browser": {
                    "name": "Firefox",
                    "version": "101.0",
                    "type": "browser"
                },
                "client_os": {
                    "name": "Windows",
                    "version": "10",
                    "type": "os"
                },
                "device": {
                    "timezone": "Romance Standard Time",
                    "timezone_display_name": "(UTC+01:00) Brussels, Copenhagen, Madrid, Paris",
                    "type": "device"
                },
                "server-os": {
                    "name": "Windows",
                    "version": "10",
                    "build": "17763",
                    "raw_description": "Microsoft Windows 10.0.17763 ",
                    "type": "os"
                },
                "server-runtime": {
                    "name": ".NET Framework",
                    "version": "4.8",
                    "raw_description": ".NET Framework 4.8.4510.0",
                    "type": "runtime"
                }
            },
            "exception": {
                "values": [
                    {
                        "type": "DepFac.ProPilot.Core.Exceptions.NotFoundException",
                        "value": "Instance with name 'wp-login.php' not found",
                        "module": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                        "stacktrace": {
                            "frames": [
                                {
                                    "function": "InvokeAction",
                                    "module": "System.Web.Mvc.ControllerActionInvoker",
                                    "package": "System.Web.Mvc, Version=5.2.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35",
                                    "in_app": false,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "InvokeAuthorizationFilters",
                                    "module": "System.Web.Mvc.ControllerActionInvoker",
                                    "package": "System.Web.Mvc, Version=5.2.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35",
                                    "in_app": false,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "OnAuthorization",
                                    "module": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
                                    "package": "DepFac.ProPilot.ASP.Common, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "SwitchInstance",
                                    "module": "DepFac.ProPilot.Core.Global.GlobalContext",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": ".ctor",
                                    "module": "DepFac.ProPilot.Core.Instances.ProPilotContext",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "RetrieveInstanceContainer",
                                    "module": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "GetInstanceByName",
                                    "module": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                }
                            ]
                        },
                        "thread_id": 47
                    }
                ]
            },
            "tags": [
                [
                    "server_name",
                    "UAT-PPL"
                ],
                [
                    "level",
                    "error"
                ],
                [
                    "logger",
                    "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController"
                ],
                [
                    "environment",
                    "Acceptance"
                ],
                [
                    "sentry:release",
                    "[email protected]"
                ],
                [
                    "url",
                    "http://dummy.domain.com/wp-login.php"
                ],
                [
                    "browser",
                    "Firefox 101.0"
                ],
                [
                    "browser.name",
                    "Firefox"
                ],
                [
                    "client_os",
                    "Windows 10"
                ],
                [
                    "client_os.name",
                    "Windows"
                ],
                [
                    "server-os",
                    "Windows 10"
                ],
                [
                    "server-os.name",
                    "Windows"
                ],
                [
                    "server-runtime",
                    ".NET Framework 4.8"
                ],
                [
                    "server-runtime.name",
                    ".NET Framework"
                ]
            ],
            "extra": {
                "ClassName": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
                "Core_Version": "3.20.10.0",
                "Domain": "/LM/W3SVC/1/ROOT-1-132987040413368077",
                "MethodName": "OnException",
                "ThreadName": "47",
                "log4net-level": "ERROR"
            },
            "sdk": {
                "name": "sentry.dotnet.log4net",
                "version": "2.1.8",
                "packages": [
                    {
                        "name": "nuget:Sentry",
                        "version": "2.1.8"
                    },
                    {
                        "name": "nuget:Sentry.Log4Net",
                        "version": "2.1.8"
                    }
                ],
                "integrations": null
            },
            "key_id": "19",
            "project": 19,
            "grouping_config": {
                "enhancements": "eJybzDRxY3J-bm5-npWRgaGlroGxrpHxBABcYgcZ",
                "id": "newstyle:2019-10-29"
            },
            "_metrics": {
                "bytes.ingested.event": 9496,
                "bytes.stored.event": 13130
            },
            "fingerprint": [
                "{{ default }}"
            ],
            "hashes": [
                "95d88c342428afbe17a37158c7bbe30f",
                "f2db7aee511f144691883bff5018ffc3"
            ],
            "culprit": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository in GetInstanceByName",
            "metadata": {
                "value": "Instance with name 'wp-login.php' not found",
                "type": "DepFac.ProPilot.Core.Exceptions.NotFoundException",
                "function": "GetInstanceByName",
                "display_title_with_tree_label": false
            },
            "title": "DepFac.ProPilot.Core.Exceptions.NotFoundException: Instance with name 'wp-login.php' not found",
            "location": null,
            "_ref": 19,
            "_ref_version": 2,
            "nodestore_insert": 1654244393.185044
        },
        "primary_hash": "95d88c342428afbe17a37158c7bbe30f",
        "retention_days": null
    },
    {
        "is_new": false,
        "is_regression": null,
        "is_new_group_environment": false,
        "skip_consume": false
    }
]

To give more context, we see that sentry continue to receive errors in the Usage Stats view but issues does not appear in project views since the update for all our projects (we have several projects using different SDK : .NET (core), angular, python, ruby).

@nikhars nikhars added bug Something isn't working and removed Status: Needs More Information labels Jun 6, 2022
@nikhars
Copy link
Member

nikhars commented Jun 6, 2022

Hello, I execute the following command in the kafka container :

root@e2f9e198454b:/# kafka-console-consumer --bootstrap-server localhost:9092 --topic events

Then I generate an error in one of our applications tracked in Sentry and I had the following output (I replaced the domain and IP by dummy values):

[
    2,
    "insert",
    {
        "group_id": 232,
        "event_id": "429b37d852ce4b32a5d60ef0d0ffa502",
        "organization_id": 1,
        "project_id": 19,
        "message": "Error while executing GET request on MVC Page: 'http://dummy.domain.com/wp-login.php', UserAgent: 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0' Instance with name 'wp-login.php' not found DepFac.ProPilot.Core.Exceptions.NotFoundException GetInstanceByName False DepFac.ProPilot.Core.Global.Repositories.InstanceRepository in GetInstanceByName",
        "platform": "csharp",
        "datetime": "2022-06-03T08:19:52.112150Z",
        "data": {
            "event_id": "429b37d852ce4b32a5d60ef0d0ffa502",
            "level": "error",
            "version": "7",
            "type": "error",
            "logentry": {
                "formatted": "Error while executing GET request on MVC Page: 'http://dummy.domain.com/wp-login.php', UserAgent: 'Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0'",
                "message": null,
                "params": null
            },
            "logger": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
            "modules": {
                "ASK.ServEasy": "4.0.1.0",
                "ASK.ServEasy.Windows": "4.0.1.0",
                "AjaxMin": "5.14.5506.26196",
                "AntiXssLibrary": "4.3.0.0",
                "App_Web_2332hona": "0.0.0.0",
                "App_Web_amvgtgl2": "0.0.0.0",
                "App_Web_frs2jr1v": "0.0.0.0",
                "App_Web_iousqpvw": "0.0.0.0",
                "App_global.asax.qeeq7hzx": "0.0.0.0",
                "Atlassian.Jira": "11.2.0.0",
                "Autofac": "4.0.1.0",
                "Autofac.Integration.Mvc": "4.0.0.0",
                "Autofac.Integration.Mvc.Owin": "4.0.0.0",
                "Autofac.Integration.Owin": "4.2.0.0",
                "Autofac.Integration.WebApi": "4.3.1.0",
                "Autofac.Integration.WebApi.Owin": "4.0.0.0",
                "BouncyCastle": "1.8.5811.20889",
                "CommonMark": "0.1.0.0",
                "CookComputing.XmlRpcV2": "2.5.0.0",
                "DataAnnotationsExtensions": "1.1.0.0",
                "DataAnnotationsExtensions.ClientValidation": "1.1.0.0",
                "DepFac.ProPilot.ASP": "3.20.10.0",
                "DepFac.ProPilot.ASP.Common": "3.20.10.0",
                "DepFac.ProPilot.Client": "1.0.0.0",
                "DepFac.ProPilot.Core": "3.20.10.0",
                "DepFac.ProPilot.ExtractReader": "1.1.63.0",
                "DotLiquid": "1.8.0.0",
                "DotNetZip": "1.15.0.0",
                "EPPlus": "4.1.0.0",
                "EntityFramework": "6.0.0.0",
                "EntityFramework.SqlServer": "6.0.0.0",
                "HtmlAgilityPack": "1.4.9.0",
                "ICSharpCode.SharpZipLib": "0.86.0.518",
                "IdentityModel": "1.0.0.0",
                "IdentityServer3": "2.6.0.0",
                "IdentityServer3.AccessTokenValidation": "1.0.0.0",
                "Ionic.Zip": "1.9.1.8",
                "Lucene.Net": "3.0.3.0",
                "MailKit": "1.2.0.0",
                "Microsoft.Build.Framework": "4.0.0.0",
                "Microsoft.Build.Utilities.v4.0": "4.0.0.0",
                "Microsoft.CSharp": "4.0.0.0",
                "Microsoft.IdentityModel.JsonWebTokens": "6.8.0.0",
                "Microsoft.IdentityModel.Logging": "6.8.0.0",
                "Microsoft.IdentityModel.Protocol.Extensions": "1.0.40306.1554",
                "Microsoft.IdentityModel.Protocols": "6.8.0.0",
                "Microsoft.IdentityModel.Protocols.OpenIdConnect": "6.8.0.0",
                "Microsoft.IdentityModel.Tokens": "6.8.0.0",
                "Microsoft.JScript": "10.0.0.0",
                "Microsoft.Owin": "4.1.1.0",
                "Microsoft.Owin.Host.SystemWeb": "4.1.1.0",
                "Microsoft.Owin.Security": "4.1.1.0",
                "Microsoft.Owin.Security.Cookies": "4.1.1.0",
                "Microsoft.Owin.Security.Jwt": "4.1.1.0",
                "Microsoft.Owin.Security.OAuth": "4.1.1.0",
                "Microsoft.Owin.Security.OpenIdConnect": "4.1.1.0",
                "Microsoft.VisualBasic.Activities.Compiler": "10.0.0.0",
                "Microsoft.Web.Infrastructure": "1.0.0.0",
                "MimeKit": "1.2.0.0",
                "MiniProfiler": "3.1.1.140",
                "Mono.Cecil": "0.9.5.0",
                "Mono.Cecil.Rocks": "0.9.5.0",
                "Mono.Security": "2.0.0.0",
                "MySql.Data": "6.9.6.0",
                "NCrontab": "3.3.1.0",
                "Newtonsoft.Json": "12.0.0.0",
                "NotFoundMvc": "1.2.0.0",
                "Npgsql": "2.0.11.0",
                "Owin": "1.0.0.0",
                "PagedList": "1.17.0.0",
                "PagedList.Mvc": "4.5.0.0",
                "RestSharp": "106.2.2.0",
                "SMDiagnostics": "4.0.0.0",
                "Sentry": "2.1.8.0",
                "Sentry.Log4Net": "2.1.8.0",
                "Sentry.PlatformAbstractions": "1.1.1.0",
                "Sentry.Protocol": "2.1.8.0",
                "ServiceStack": "3.9.71.0",
                "ServiceStack.Common": "3.9.71.0",
                "ServiceStack.FluentValidation.Mvc3": "3.9.71.0",
                "ServiceStack.Interfaces": "1.0.0.0",
                "ServiceStack.OrmLite": "3.9.71.0",
                "ServiceStack.OrmLite.MySql": "3.9.71.0",
                "ServiceStack.OrmLite.PostgreSQL": "3.9.71.0",
                "ServiceStack.OrmLite.SqlServer": "3.9.71.0",
                "ServiceStack.OrmLite.SqliteNET": "3.9.71.0",
                "ServiceStack.Redis": "3.9.71.0",
                "ServiceStack.ServiceInterface": "3.9.71.0",
                "ServiceStack.Text": "3.9.71.0",
                "System": "4.0.0.0",
                "System.Activities": "4.0.0.0",
                "System.ComponentModel.DataAnnotations": "4.0.0.0",
                "System.Configuration": "4.0.0.0",
                "System.Configuration.Install": "4.0.0.0",
                "System.Core": "4.0.0.0",
                "System.Data": "4.0.0.0",
                "System.Data.DataSetExtensions": "4.0.0.0",
                "System.Data.Entity": "4.0.0.0",
                "System.Data.Linq": "4.0.0.0",
                "System.Data.SQLite": "1.0.96.0",
                "System.Data.SQLite.EF6": "1.0.113.0",
                "System.Data.SQLite.Linq": "1.0.113.0",
                "System.Data.SqlXml": "4.0.0.0",
                "System.Design": "4.0.0.0",
                "System.Drawing": "4.0.0.0",
                "System.Dynamic": "4.0.0.0",
                "System.EnterpriseServices": "4.0.0.0",
                "System.IdentityModel": "4.0.0.0",
                "System.IdentityModel.Tokens.Jwt": "6.8.0.0",
                "System.Json": "4.0.0.0",
                "System.Management": "4.0.0.0",
                "System.Net.Http": "4.0.0.0",
                "System.Net.Http.Formatting": "5.2.7.0",
                "System.Numerics": "4.0.0.0",
                "System.Runtime.Caching": "4.0.0.0",
                "System.Runtime.DurableInstancing": "4.0.0.0",
                "System.Runtime.InteropServices.RuntimeInformation": "4.0.0.0",
                "System.Runtime.Serialization": "4.0.0.0",
                "System.Security": "4.0.0.0",
                "System.ServiceModel": "4.0.0.0",
                "System.ServiceModel.Activation": "4.0.0.0",
                "System.ServiceModel.Activities": "4.0.0.0",
                "System.ServiceModel.Internals": "4.0.0.0",
                "System.ServiceModel.Web": "4.0.0.0",
                "System.ServiceProcess": "4.0.0.0",
                "System.Transactions": "4.0.0.0",
                "System.Web": "4.0.0.0",
                "System.Web.Abstractions": "4.0.0.0",
                "System.Web.ApplicationServices": "4.0.0.0",
                "System.Web.Cors": "5.2.7.0",
                "System.Web.DataVisualization": "4.0.0.0",
                "System.Web.DynamicData": "4.0.0.0",
                "System.Web.Extensions": "4.0.0.0",
                "System.Web.Helpers": "3.0.0.0",
                "System.Web.Http": "5.2.7.0",
                "System.Web.Http.Cors": "5.2.7.0",
                "System.Web.Http.Owin": "5.2.7.0",
                "System.Web.Http.WebHost": "5.2.7.0",
                "System.Web.Mobile": "4.0.0.0",
                "System.Web.Mvc": "5.2.7.0",
                "System.Web.Razor": "3.0.0.0",
                "System.Web.RegularExpressions": "4.0.0.0",
                "System.Web.Services": "4.0.0.0",
                "System.Web.WebPages": "3.0.0.0",
                "System.Web.WebPages.Deployment": "3.0.0.0",
                "System.Web.WebPages.Razor": "3.0.0.0",
                "System.Windows.Forms": "4.0.0.0",
                "System.Workflow.Activities": "4.0.0.0",
                "System.Workflow.ComponentModel": "4.0.0.0",
                "System.Workflow.Runtime": "4.0.0.0",
                "System.WorkflowServices": "4.0.0.0",
                "System.Xaml": "4.0.0.0",
                "System.Xaml.Hosting": "4.0.0.0",
                "System.Xml": "4.0.0.0",
                "System.Xml.Linq": "4.0.0.0",
                "Thinktecture.IdentityModel.Client.Net45": "1.0.0.0",
                "Weavers": "1.0.0.0",
                "WebActivator": "1.5.3.0",
                "WeifenLuo.WinFormsUI.Docking": "2.9.0.0",
                "dFakto.Tools": "2.0.13.0",
                "dFakto.Tools.Excel": "2.0.13.0",
                "hbehr.recaptcha": "1.1.0.0",
                "log4net": "2.0.12.0",
                "mscorlib": "4.0.0.0",
                "netstandard": "2.0.0.0"
            },
            "platform": "csharp",
            "timestamp": 1654244392.11215,
            "received": 1654244392.139693,
            "release": "[email protected]",
            "environment": "Acceptance",
            "request": {
                "url": "http://dummy.domain.com/wp-login.php",
                "method": "GET",
                "headers": [
                    [
                        "Accept",
                        "text/html,application/xhtml+xml,application/xml;q=0.9,image/avif,image/webp,*/*;q=0.8"
                    ],
                    [
                        "Accept-Encoding",
                        "gzip, deflate, br"
                    ],
                    [
                        "Accept-Language",
                        "en-US,en;q=0.5"
                    ],
                    [
                        "Connection",
                        "close"
                    ],
                    [
                        "Host",
                        "dummy.domain.com"
                    ],
                    [
                        "Sec-Fetch-Dest",
                        "document"
                    ],
                    [
                        "Sec-Fetch-Mode",
                        "navigate"
                    ],
                    [
                        "Sec-Fetch-Site",
                        "none"
                    ],
                    [
                        "Sec-Fetch-User",
                        "?1"
                    ],
                    [
                        "Upgrade-Insecure-Requests",
                        "1"
                    ],
                    [
                        "User-Agent",
                        "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:101.0) Gecko/20100101 Firefox/101.0"
                    ],
                    [
                        "X-Forwarded-For",
                        "0.0.0.0"
                    ],
                    [
                        "X-Forwarded-Proto",
                        "https"
                    ],
                    [
                        "X-Real-IP",
                        "0.0.0.0"
                    ]
                ],
                "query_string": [],
                "fragment": null,
                "cookies": null,
                "data": null,
                "env": null,
                "inferred_content_type": null
            },
            "contexts": {
                "CurrentCulture": {
                    "Calendar": "GregorianCalendar",
                    "DisplayName": "English (United States)",
                    "Name": "en-US",
                    "type": "CurrentCulture"
                },
                "CurrentUICulture": {
                    "Calendar": "GregorianCalendar",
                    "DisplayName": "English (United States)",
                    "Name": "en-US",
                    "type": "CurrentUICulture"
                },
                "browser": {
                    "name": "Firefox",
                    "version": "101.0",
                    "type": "browser"
                },
                "client_os": {
                    "name": "Windows",
                    "version": "10",
                    "type": "os"
                },
                "device": {
                    "timezone": "Romance Standard Time",
                    "timezone_display_name": "(UTC+01:00) Brussels, Copenhagen, Madrid, Paris",
                    "type": "device"
                },
                "server-os": {
                    "name": "Windows",
                    "version": "10",
                    "build": "17763",
                    "raw_description": "Microsoft Windows 10.0.17763 ",
                    "type": "os"
                },
                "server-runtime": {
                    "name": ".NET Framework",
                    "version": "4.8",
                    "raw_description": ".NET Framework 4.8.4510.0",
                    "type": "runtime"
                }
            },
            "exception": {
                "values": [
                    {
                        "type": "DepFac.ProPilot.Core.Exceptions.NotFoundException",
                        "value": "Instance with name 'wp-login.php' not found",
                        "module": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                        "stacktrace": {
                            "frames": [
                                {
                                    "function": "InvokeAction",
                                    "module": "System.Web.Mvc.ControllerActionInvoker",
                                    "package": "System.Web.Mvc, Version=5.2.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35",
                                    "in_app": false,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "InvokeAuthorizationFilters",
                                    "module": "System.Web.Mvc.ControllerActionInvoker",
                                    "package": "System.Web.Mvc, Version=5.2.7.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35",
                                    "in_app": false,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "OnAuthorization",
                                    "module": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
                                    "package": "DepFac.ProPilot.ASP.Common, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "SwitchInstance",
                                    "module": "DepFac.ProPilot.Core.Global.GlobalContext",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": ".ctor",
                                    "module": "DepFac.ProPilot.Core.Instances.ProPilotContext",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "RetrieveInstanceContainer",
                                    "module": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                },
                                {
                                    "function": "GetInstanceByName",
                                    "module": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository",
                                    "package": "DepFac.ProPilot.Core, Version=3.20.10.0, Culture=neutral, PublicKeyToken=null",
                                    "in_app": true,
                                    "abs_path": null,
                                    "colno": null,
                                    "context_line": null,
                                    "data": null,
                                    "errors": null,
                                    "filename": null,
                                    "raw_function": null,
                                    "image_addr": null,
                                    "instruction_addr": null,
                                    "addr_mode": null,
                                    "lineno": null,
                                    "platform": null,
                                    "post_context": null,
                                    "pre_context": null,
                                    "symbol": null,
                                    "symbol_addr": null,
                                    "trust": null,
                                    "vars": null,
                                    "snapshot": null
                                }
                            ]
                        },
                        "thread_id": 47
                    }
                ]
            },
            "tags": [
                [
                    "server_name",
                    "UAT-PPL"
                ],
                [
                    "level",
                    "error"
                ],
                [
                    "logger",
                    "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController"
                ],
                [
                    "environment",
                    "Acceptance"
                ],
                [
                    "sentry:release",
                    "[email protected]"
                ],
                [
                    "url",
                    "http://dummy.domain.com/wp-login.php"
                ],
                [
                    "browser",
                    "Firefox 101.0"
                ],
                [
                    "browser.name",
                    "Firefox"
                ],
                [
                    "client_os",
                    "Windows 10"
                ],
                [
                    "client_os.name",
                    "Windows"
                ],
                [
                    "server-os",
                    "Windows 10"
                ],
                [
                    "server-os.name",
                    "Windows"
                ],
                [
                    "server-runtime",
                    ".NET Framework 4.8"
                ],
                [
                    "server-runtime.name",
                    ".NET Framework"
                ]
            ],
            "extra": {
                "ClassName": "DepFac.ProPilot.ASP.Common.Controllers.Global.BaseController",
                "Core_Version": "3.20.10.0",
                "Domain": "/LM/W3SVC/1/ROOT-1-132987040413368077",
                "MethodName": "OnException",
                "ThreadName": "47",
                "log4net-level": "ERROR"
            },
            "sdk": {
                "name": "sentry.dotnet.log4net",
                "version": "2.1.8",
                "packages": [
                    {
                        "name": "nuget:Sentry",
                        "version": "2.1.8"
                    },
                    {
                        "name": "nuget:Sentry.Log4Net",
                        "version": "2.1.8"
                    }
                ],
                "integrations": null
            },
            "key_id": "19",
            "project": 19,
            "grouping_config": {
                "enhancements": "eJybzDRxY3J-bm5-npWRgaGlroGxrpHxBABcYgcZ",
                "id": "newstyle:2019-10-29"
            },
            "_metrics": {
                "bytes.ingested.event": 9496,
                "bytes.stored.event": 13130
            },
            "fingerprint": [
                "{{ default }}"
            ],
            "hashes": [
                "95d88c342428afbe17a37158c7bbe30f",
                "f2db7aee511f144691883bff5018ffc3"
            ],
            "culprit": "DepFac.ProPilot.Core.Global.Repositories.InstanceRepository in GetInstanceByName",
            "metadata": {
                "value": "Instance with name 'wp-login.php' not found",
                "type": "DepFac.ProPilot.Core.Exceptions.NotFoundException",
                "function": "GetInstanceByName",
                "display_title_with_tree_label": false
            },
            "title": "DepFac.ProPilot.Core.Exceptions.NotFoundException: Instance with name 'wp-login.php' not found",
            "location": null,
            "_ref": 19,
            "_ref_version": 2,
            "nodestore_insert": 1654244393.185044
        },
        "primary_hash": "95d88c342428afbe17a37158c7bbe30f",
        "retention_days": null
    },
    {
        "is_new": false,
        "is_regression": null,
        "is_new_group_environment": false,
        "skip_consume": false
    }
]

To give more context, we see that sentry continue to receive errors in the Usage Stats view but issues does not appear in project views since the update for all our projects (we have several projects using different SDK : .NET (core), angular, python, ruby).

Thanks for providing the additional information. I have added a bug label to the issue and we will work on the fix on our end.

@MeredithAnya MeredithAnya mentioned this issue Jun 13, 2022
Merged
@pierresebastien
Copy link
Author

I tried to update my on premise sentry to version 22.6.0 but the issue remains. I check the version used for snuba and it was also version 22.6.0 which should contains your commit according the commit history of this repository.

Like described in the sdk section of the event that I posted earlier, I'm using a quite old version of Sentry.Log4Net package (late 2020 version). Do you think that the error may disappear if I update the library ? If not, could you give me some hint to try to gather more information on my side?

Many thanks in advance

@larsnystrom
Copy link

larsnystrom commented Jul 2, 2022 •
edited
Loading

I'm also still having this issue on 22.6.0 and can also confirm it contains the change from #2809. I'm not using Sentry.Log4Net so I don't think the issue is there. I'm not a Python developer but I assume either settings.DEFAULT_RETENTION_DAYS or settings.LOWER_RETENTION_DAYS is a string and not an int.

snuba/snuba/datasets/events_format.py

Lines 116 to 127 in 28891df

def enforce_retention(
retention_days: Optional[int], timestamp: Optional[datetime]
) -> int:
if not isinstance(retention_days, int):
retention_days = settings.DEFAULT_RETENTION_DAYS
if settings.ENFORCE_RETENTION:
retention_days = (
settings.LOWER_RETENTION_DAYS
if retention_days <= settings.LOWER_RETENTION_DAYS
else settings.DEFAULT_RETENTION_DAYS
)

Edit: Solution: I started a shell in the snuba-consumer container with docker-compose exec -u root snuba-consumer bash -l, installed nano and then edited snuba/datasets/events_format.py adding the line retention_days = int(retention_days) after line 127 and can confirm that this solves the issue for me.

@pierresebastien
Copy link
Author

Hello, I just update my on premise Sentry to version 22.7.0 and the issue is still present. Could you consider applying the solution provided by @larsnystrom ?
I can apply it myself on my instance but I would have to do it after each upgrade of Sentry (so each month)

@blattersturm blattersturm mentioned this issue Aug 20, 2022
Closed
@ethanhs
Copy link
Contributor

ethanhs commented Jan 25, 2023

Hey @MeredithAnya it seems that #2809 did not completely fix the retention days variable not always being an integer :/

It seems people are still hitting issues on the latest version of self-hosted Sentry.. Perhaps we can re-open this to track further issues? Let me know if I can be of help in fixing these issues.

@larsnystrom-client larsnystrom-client mentioned this issue Oct 25, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

enforce retention_days is int type getsentry/snuba
4 participants
@larsnystrom @pierresebastien @ethanhs @nikhars