python - LookupError: Resource 'corpora/stopwords' not found -

-

i trying run webapp on heroku using flask. webapp programmed in python nltk (natural language toolkit library).

one of file has following header:

import nltk, json, operator nltk.corpus import stopwords  nltk.tokenize import regexptokenizer

when webpage stopwords code called, produces following error:

lookuperror:  **********************************************************************   resource 'corpora/stopwords' not found.  please use nltk     downloader obtain resource:  >>> nltk.download()     searched in:       - '/app/nltk_data'       - '/usr/share/nltk_data'       - '/usr/local/share/nltk_data'       - '/usr/lib/nltk_data'       - '/usr/local/lib/nltk_data'   **********************************************************************

the exact code used:

#remove punctuation   toker = regexptokenizer(r'((?<=[^\w\s])\w(?=[^\w\s])|(\w))+', gaps=true)  data = toker.tokenize(data)    #remove stop words , digits  stopword = stopwords.words('english')   data = [w w in data if w not in stopword , not w.isdigit()]

the webapp on heroku doesn't produce lookup error when stopword = stopwords.words('english') commented out.

the code runs without glitch on local computer. have have installed required libraries on computer using 

pip install requirements.txt

the virtual environment provided heroku running when tested code on computer.

i have tried nltk provided 2 different sources, lookuperror still there. 2 sources used are:
http://pypi.python.org/packages/source/n/nltk/nltk-2.0.1rc4.zip
https://github.com/nltk/nltk.git

the problem corpus ('stopwords' in case) doesn't uploaded heroku. code works on local machine because has nltk corpus. please follow these steps solve issue.

  1. create new directory in project (let's call 'nltk_data')
  2. download nltk corpus in directory. have configure during download.
  3. tell nltk particular path. add nltk.data.path.append('path_to_nltk_data') python file that's using nltk.
  4. now push app heroku.

hope solves problem. worked me!


Comments

Post a Comment

Popular posts from this blog

C# random value from dictionary and tuple -

-
i have following code, , need random item contains string "region_1" dictionary. public static dictionary<int, tuple<string, int, currencytype>> itemarray = new dictionary<int, tuple<string, int, currencytype>>() { { 0xb3e, new tuple<string, int, currencytype>("region_1", 1500, currencytype.fame) } }; public static int generateitemid(string shopid) { var generateditem = itemarray.elementat(new random().next(0, itemarray.count)).key; } how select this? it's not possible efficiently... first create static random @ class level... prevent non-random behaviour if run query on short period of time... (it's seeded discrete clock) static random rnd = new random(); then: var item = itemarray.values .where(t => t.item1 == shopid) .orderby(_ => rnd.next()) .firstordefault()
Read more

cgi - How do I interpret URLs without extension as files rather than missing directories in nginx? -

-
so i'm trying install zoneminder , have run under nginx, has few compiled files need run using fast-cgi. these files lack extension. if file has extension, there no issue , nginx interprets file , return 404 if can't find it. if has no extension, assume it's directory , return 404 when can't find sort of index page. here have now: # security camera domain. server { listen 888; server_name mydomain.com; root /srv/http/zm; # enable php support. include php.conf; location / { index index.html index.htm index.php; } # enable cgi support. location ~ ^/cgi-bin/(.+)$ { alias /srv/cgi-bin/zm/; fastcgi_pass unix:/run/fcgiwrap.sock; fastcgi_param script_filename $document_root/$1; include fastcgi.conf; } } the idea is, under cgi-bin directory goes through fastcgi pipe. any idea on howi can fix this? upon closer inspection, realized zoneminder has 2 cgi sc...
Read more

.htaccess - htaccess convert request to clean url and add slash at the end of the url -

-
ok , searched more 4 days , more 20 posts here in stach or in websites without kind of success first here htaccess file rewriteengine on rewriterule ^([a-za-z0-9_]+)/?$ index.php?page=$1 [nc] rewriterule ^([a-za-z0-9_]+)\/([a-za-z0-9_]+)\/?$ index.php?page=$1&action=$2 [nc] i tried many codes 1 worked me can call request , works me www.example.com/pagename => www.example.com/index.php?page=pagename here questions , please provide me information "in detail" understand code well 1- how convert request automatically www.example.com/index.php?page=pagename www.example.com/pagename 2- if tried add slash @ end shows me page without images or styling mean www.example.com/pagename => works www.example.com/pagename/ => doesn't work that's :) for first part need 301 rule this: rewritecond %{the_request} /index\.php\?page=([^\s&]+) [nc] rewriterule ^ /%1? [r=301,l] for second part use absolute path in css, js, images files r...
Read more