pylint exceed maximum recursion depth #2388

skirpichev · 2018-08-07T07:33:19Z

There are similar errors in bugtracker, e.g. #1410, #1285, but I'm not sure the underlying reason for this issue is same.

Steps to reproduce

python3 -m venv ~/venv/pylint-test
. ~/venv/pylint-test/bin/activate
Follow http://diofant.readthedocs.io/en/latest/install.html#from-sources
run pylint --enable=old-raise-syntax diofant/solvers/recurr.py

Current behavior

It fails with

internal error with sending report for module ['diofant/solvers/recurr.py']
maximum recursion depth exceeded

Expected behavior

No internal error.

pylint --version output

pylint 2.1.0
astroid 2.0.2
Python 3.5.3 (default, Jan 19 2017, 14:11:04) 
[GCC 6.3.0 20170118]

Some debugging

Note, that same error happens if you enable different checker instead, almost any disabled. For example, exception-message-attribute. The internal error disappears if I comment out line 527.

The text was updated successfully, but these errors were encountered:

brycepg · 2018-08-08T01:07:11Z

Here's my somewhat easier reproduction:

Install diofant
Save the following code in a file named file.py

from diofant.simplify import hypersimp, simplify

def rsolve_hyper():
    b = simplify(g)
    s = hypersimp(b, n)
    s.subs()

Run
pylint -j1 -rn -sn --enable=all file.py

The -j1 option makes pylint use a single threaded reporter which shows the traceback:

  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/__main__.py", line 7, in <module>
    pylint.run_pylint()
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/__init__.py", line 19, in run_pylint
    Run(sys.argv[1:])
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/lint.py", line 1394, in __init__
    linter.check(args)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/lint.py", line 801, in check
    self._do_check(files_or_modules)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/lint.py", line 938, in _do_check
    self.check_astroid_module(ast_node, walker, rawcheckers, tokencheckers)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/lint.py", line 1018, in check_astroid_module
    walker.walk(ast_node)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/utils.py", line 1162, in walk
    self.walk(child)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/utils.py", line 1162, in walk
    self.walk(child)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/utils.py", line 1162, in walk
    self.walk(child)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/utils.py", line 1159, in walk
    cb(astroid)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/checkers/refactoring.py", line 961, in visit_call
    inferred = utils.safe_infer(node.func)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/pylint/checkers/utils.py", line 828, in safe_infer
    value = next(inferit)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 92, in wrapped
    res = next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 125, in raise_if_nothing_inferred
    yield next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/inference.py", line 293, in infer_attribute
    for owner in self.expr.infer(context):
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/util.py", line 148, in limit_inference
    yield from islice(iterator, size)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/context.py", line 107, in cache_generator
    for result in generator:
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 125, in raise_if_nothing_inferred
    yield next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 92, in wrapped
    res = next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/bases.py", line 125, in _infer_stmts
    for inferred in stmt.infer(context=context):
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/util.py", line 148, in limit_inference
    yield from islice(iterator, size)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/context.py", line 107, in cache_generator
    for result in generator:
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 125, in raise_if_nothing_inferred
    yield next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 92, in wrapped
    res = next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/bases.py", line 125, in _infer_stmts
    for inferred in stmt.infer(context=context):
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/util.py", line 148, in limit_inference
    yield from islice(iterator, size)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/context.py", line 107, in cache_generator
    for result in generator:
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 125, in raise_if_nothing_inferred
    yield next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 92, in wrapped
    res = next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/inference.py", line 219, in infer_call
    context=callcontext,
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/scoped_nodes.py", line 1628, in infer_call_result
    yield from returnnode.value.infer(context)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/util.py", line 148, in limit_inference
    yield from islice(iterator, size)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/context.py", line 107, in cache_generator
    for result in generator:
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 125, in raise_if_nothing_inferred
    yield next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 92, in wrapped
    res = next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/inference.py", line 219, in infer_call
    context=callcontext,
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/scoped_nodes.py", line 1628, in infer_call_result
    yield from returnnode.value.infer(context)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/util.py", line 148, in limit_inference
    yield from islice(iterator, size)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/context.py", line 107, in cache_generator
    for result in generator:
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 125, in raise_if_nothing_inferred
    yield next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 92, in wrapped
    res = next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/inference.py", line 211, in infer_call
    for callee in self.func.infer(context):
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/util.py", line 148, in limit_inference
    yield from islice(iterator, size)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/context.py", line 107, in cache_generator
    for result in generator:
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 92, in wrapped
    res = next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/decorators.py", line 125, in raise_if_nothing_inferred
    yield next(generator)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/inference.py", line 293, in infer_attribute
...
    context = contextmod.copy_context(context)
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/context.py", line 146, in copy_context
    return context.clone()
  File "/home/user/venv/pylint-issue-2388/lib/python3.6/site-packages/astroid/context.py", line 96, in clone
    clone = InferenceContext(copy.copy(self.path), inferred=self.inferred)
RecursionError: maximum recursion depth exceeded

brycepg · 2018-08-08T02:16:01Z

So it looks like this is just a stack limit issue (is not infinite recursion). The only way to reproduce this issue without pylint is to add extra calls to the call stack:

import astroid

def f():
    return astroid.extract_node("""
    from diofant.simplify import hypersimp, simplify
    def rsolve_hyper():
        b = simplify(g)
        s = hypersimp(b, n)
        s.subs() #@
    """).inferred()

def a(n=5):
    if n > 0:
        return a(n-1)
    else:
        return f()
a()

I think I might merge a few astroid calls to lower the stack size

brycepg · 2018-08-10T04:46:12Z

I fixed this issue on a local branch, but running pylint on this package didn't complete even overnight.. Not sure if the fix is worth it -- I think astroid has some perf issues with complex class hierarchies

(see https://github.com/brycepg/astroid/tree/inline-calls)

PCManticore · 2018-08-15T16:29:45Z

We probably need to figure out what's the root cause of this problem. As Bryce mentioned, pylint is not even able to complete in a reasonable amount of time. I've tried increasing the recursion limit with --init-hook="import sys; sys.setrecursionlimit(2000)" and pylint gets stuck.

skirpichev · 2018-08-15T17:33:07Z

I've tried increasing the recursion limit with --init-hook="import sys; sys.setrecursionlimit(2000)" and pylint gets stuck.

Is this for whole project tree?

I have tried original example from bugreport (for diofant/solvers/recurr.py) with increased recursion limit (as you suggested, with --init-hook) and the test pass (it's slow, but not hangs forever).

PCManticore · 2018-08-15T17:38:32Z

Just for the original example. I stopped it after a couple of minutes, maybe it would have completed later on.

dragoljub · 2019-06-08T00:05:09Z

I'm seeing the same issue on Python 3.7 and Windows 10 in VS Code. Any ideas how to resolve?

tomarharsh · 2019-07-11T22:13:54Z

Same issue with Python 3.7, Mojave 10.14, VS Code.

LuoPengFei · 2019-07-19T11:26:55Z

Same issue with Python 3.7, VS Code 1.36.1 (1.36.1), Mojave 10.14.5

karlicoss · 2019-08-04T20:34:57Z

I'm running into that with the following code snippet:

import pandas as pd
df = pd.merge(df)

Astroid 1.4.1; pylint 2.3.1

corndog2000 · 2019-08-07T14:52:20Z

Same error message with Python 3.7.3, Ubuntu 18.04.2, VS Code 1.36.1.

Picture of error: https://imgur.com/a/PTNkteD

dragoljub · 2019-08-07T15:33:09Z

My issue was resolved on Python 3.7.1 after upgrading to these versions:
astroid 2.2.5
pylint 2.3.1

See pylint-dev/pylint#2388

andreasvc · 2019-10-24T08:44:00Z

FWIW, I think I encountered the same or a similar bug.

In my case, I tracked down that the problem was with the option --extension-pkg-whitelist=[...]. If numpy is included in this list, the issue occurs, if I leave it out, it's gone.

- use pycodestyle instead of pep8 - disable import-outside-toplevel - remove numpy from whitelist because of pylint issue pylint-dev/pylint#2388

dragoljub · 2019-10-24T19:05:29Z

Thanks for the tip. I actually had that setting before and still keep it on. --extension-pkg-whitelist=numpy

However, after upgrading to later versions of python and pylint and astroid I no longer have the issue even with the numpy whitelist setting.

Python 3.7.1
pylint 2.3.1
astroid 2.2.5

feliwir · 2020-01-15T09:27:33Z

Any updates on how to get rid of this issue?

ashkan-leo · 2020-03-04T02:04:18Z

Any update on how to solve this issue?

PCManticore · 2020-03-12T10:22:33Z

The original issue is no longer reproduceable with the following versions, installed from master branch for both pylint and astroid:

pylint 2.5.0-dev1
astroid 2.4.0
Python 3.8.1 (default, Feb 13 2020, 10:17:07)
[Clang 8.1.0 (clang-802.0.42)]

It's also no longer reproduceable with the already released versions of pylint 2.4.4 and astroid 2.3.3.

@skirpichev Please give it a go with the aforementioned versions and let us know if you can still reproduce the issue.

For other folks commenting here, if your issue is not related to diophant, please submit a separate one. Thanks!

dickreuter · 2020-12-15T19:11:11Z

The issue is definitely not resolved, neither for 2.4.4, nor for 2.3.1 nor for 2.6. The only way to solve the problem is to downgrade Astroid to 2.2.5. Otherwise the problem occurs intermittently, which makes it hard to reproduce on a permanent basis.

ohaibbq · 2020-12-15T22:56:08Z

I'm also seeing the behavior with pylint==2.6.0 & astroid==2.4.2.

Yevgnen · 2020-12-17T02:23:19Z

Facing the same issue with

pylint 2.6.0 python code static checker
├── astroid >=2.4.0,<=2.5
│   ├── lazy-object-proxy >=1.4.0,<1.5.0
│   ├── six >=1.12,<2.0
│   └── wrapt >=1.11,<2.0
├── colorama *
├── isort >=4.2.5,<6
├── mccabe >=0.6,<0.7
└── toml >=0.7.1

hippo91 · 2020-12-20T15:53:48Z

@dickreuter can you please open a different issue with a reproducer in it please?

summer-via · 2022-06-09T07:33:15Z

I upgrade pylint from 2.5.3 to 2.14.1, then it is solved.

brycepg added Bug 🪲 Astroid Related to astroid labels Aug 7, 2018

PCManticore added the performance label Aug 15, 2018

Rogdham mentioned this issue Aug 31, 2018

Other example of maximum recursion depth #2463

Closed

DanAlbert mentioned this issue Nov 10, 2018

python3.6 maximum recursion depth exceeded #2591

Closed

purplehat7 mentioned this issue Nov 30, 2018

RecursionError with Python3.7.1 linting 3 line file that uses s3fs #2627

Closed

skirpichev added a commit to skirpichev/diofant that referenced this issue Mar 27, 2019

Add workaround for pylint-dev/pylint#2388

4d59401

skirpichev added a commit to skirpichev/diofant that referenced this issue Mar 30, 2019

Add workaround for pylint-dev/pylint#2388

d90553a

skirpichev added a commit to skirpichev/diofant that referenced this issue Apr 1, 2019

Add workaround for pylint-dev/pylint#2388

46e82f5

okin mentioned this issue Apr 10, 2019

pylint crashes with RecursionError: maximum recursion depth exceeded while calling a Python object #2861

Closed

abhinav-upadhyay added a commit to ApptuitAI/apptuit-py that referenced this issue Oct 18, 2019

Disable pylint for Python 3.7 as it has issues

1a5ac63

See pylint-dev/pylint#2388

andreasvc added a commit to andreasvc/disco-dop that referenced this issue Oct 24, 2019

tweak linting

982e782

- use pycodestyle instead of pep8 - disable import-outside-toplevel - remove numpy from whitelist because of pylint issue pylint-dev/pylint#2388

PCManticore closed this as completed Mar 12, 2020

PCManticore mentioned this issue Mar 12, 2020

maximum recursion depth exceeded after upgrade to the recent pylint & astroid #2628

Closed

rfinck mentioned this issue Aug 26, 2020

DPPA-1123 Rename mibitracker-client to mibilib ionpath/mibilib#99

Merged

dominiquesydow mentioned this issue Dec 17, 2020

Pylint RecursionError volkamerlab/opencadd#63

Closed

1 task

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

pylint exceed maximum recursion depth #2388

pylint exceed maximum recursion depth #2388

skirpichev commented Aug 7, 2018

brycepg commented Aug 8, 2018 •

edited

Loading

brycepg commented Aug 8, 2018 •

edited

Loading

brycepg commented Aug 10, 2018 •

edited

Loading

PCManticore commented Aug 15, 2018

skirpichev commented Aug 15, 2018

PCManticore commented Aug 15, 2018

dragoljub commented Jun 8, 2019

tomarharsh commented Jul 11, 2019

LuoPengFei commented Jul 19, 2019

karlicoss commented Aug 4, 2019

corndog2000 commented Aug 7, 2019

dragoljub commented Aug 7, 2019

andreasvc commented Oct 24, 2019

dragoljub commented Oct 24, 2019 •

edited

Loading

feliwir commented Jan 15, 2020

ashkan-leo commented Mar 4, 2020

PCManticore commented Mar 12, 2020

dickreuter commented Dec 15, 2020 •

edited

Loading

ohaibbq commented Dec 15, 2020

Yevgnen commented Dec 17, 2020

hippo91 commented Dec 20, 2020

summer-via commented Jun 9, 2022

pylint exceed maximum recursion depth #2388

pylint exceed maximum recursion depth #2388

Comments

skirpichev commented Aug 7, 2018

Steps to reproduce

Current behavior

Expected behavior

pylint --version output

Some debugging

brycepg commented Aug 8, 2018 • edited Loading

brycepg commented Aug 8, 2018 • edited Loading

brycepg commented Aug 10, 2018 • edited Loading

PCManticore commented Aug 15, 2018

skirpichev commented Aug 15, 2018

PCManticore commented Aug 15, 2018

dragoljub commented Jun 8, 2019

tomarharsh commented Jul 11, 2019

LuoPengFei commented Jul 19, 2019

karlicoss commented Aug 4, 2019

corndog2000 commented Aug 7, 2019

dragoljub commented Aug 7, 2019

andreasvc commented Oct 24, 2019

dragoljub commented Oct 24, 2019 • edited Loading

feliwir commented Jan 15, 2020

ashkan-leo commented Mar 4, 2020

PCManticore commented Mar 12, 2020

dickreuter commented Dec 15, 2020 • edited Loading

ohaibbq commented Dec 15, 2020

Yevgnen commented Dec 17, 2020

hippo91 commented Dec 20, 2020

summer-via commented Jun 9, 2022

brycepg commented Aug 8, 2018 •

edited

Loading

brycepg commented Aug 8, 2018 •

edited

Loading

brycepg commented Aug 10, 2018 •

edited

Loading

dragoljub commented Oct 24, 2019 •

edited

Loading

dickreuter commented Dec 15, 2020 •

edited

Loading