Guide: Manual Install ERPNext on Ubuntu 16.xx & Debian v8 & 9

saidsl · April 14, 2017, 5:12pm

Hi All,

After doing a clean manual install for Ubuntu 16.xx & Debian v8 & 9 (Specifically Debian Stretch) to understand what some of the issues/errors that we all get, following is what I ended up with that solves some of issues that come up. If anyone comes across any issues and resolves them please add them to the steps here. This is not final and I expect it can be refined further.

NOTE: This of course could vary for everyone. But a few things to take into consideration

Clean install on Ubuntu & Debian
User is frappe with sudo privileges
Replace apt with apt-get for ubuntu
Also a good idea to check if you already have some of the items below installed simply do a -V or --version
Installed on Virtualbox Virtual machines
Debian specs
NAME="Debian GNU/Linux" VERSION_ID="9" VERSION="9 (stretch)" ISO Image Used: debian-stretch-DI-rc2-amd64-netinst.iso
Ubuntu Specs
Description: Ubuntu 16.10 Release: 16.10 Codename: yakkety ISO Image Used: ubuntu-16.10-server-amd64.iso

Login As Root User or use SUDO

apt upgrade
apt update
adduser frappe (not required if you have added the user during VM setup)
usermod -aG sudo frappe
apt install build-essential
apt install software-properties-common
apt-key adv --recv-keys --keyserver keyserver.ubuntu.com 0xF1656F24C74CD1D8
apt install dirmngr
apt install curl
apt install mariadb-client mariadb-server Test the install: mysql -u root -p
apt install nginx Test the install: http://[IP-NUMBER-OF-INSTALL_SERVER]
curl -sL https://deb.nodesource.com/setup_7.x | sudo bash -
apt install nodejs Test the install: node -v && npm -v
apt install redis-server Test the install: redis-server -v
apt install wkhtmltopdf
apt install git-core (will be needed during installation of Bench, Frappe & ERPNext)
apt install python-pip
apt install libmysqlclient-dev and/or apt-get install libmariadbclient-dev / apt-get install python-mysqldb (This resolves the issue of Python not connecting to MariaDB MySQL)
apt install libssl-dev
pip install --upgrade setuptools
pip install MySQL-python --no-use-wheel (Wheel does not have a MySQL-python module yet, so it will error if the -no-use-wheel is not flagged)
apt install supervisor (needed for production mode)

Reboot server
Login as As frappe User

git clone https://github.com/frappe/bench bench-repo
sudo pip install -e bench-repo
bench init frappe-bench && cd frappe-bench
bench new-site site1.local
bench start To Test Installation
If there are issues in accessing the site @ http://[SERVER-IP:8000] do a bench reinstall

Reboot server
Login as As frappe User

bench get-app erpnext https://github.com/frappe/erpnext
bench --site site1.local install-app erpnext
bench start
bench setup production [frappe] to switch to production as this is develop

IMPORTANT: This is a pure manual install with nothing on the servers and its for that reason that there are many installs. I would highly recommend you use the easy install option as that is what I have successfully used numerous times. All in all this install took me about 7-8 hours to complete.

saidsl · April 15, 2017, 4:12am

There’s an issue during the setup part and following seems to resolve it

1. bench reinstall
2. bench clear-cache
3. Ensure you have at least 2gb RAM allocated to the server
4. Commence install
5. Uncheck all checked boxes in User Setup section
6. Uncheck both "Add sample records & Setup a simple website for my organisation"

johnskywalker · April 15, 2017, 11:10am

Good guide! But why are you doing manual install? when you can do easy install.

saidsl · April 15, 2017, 11:17am

@johnskywalker , I’ve actually never did a manual install. This was an exercise to better understand what is involved and many it seems do manual installs because they have existing server and so forth.

Basically, wanted to know as well what it entails to do a manual install and the issues that arise from it.

Also hoping that by sharing the steps, it would reduce the posts about installation issues.

I have explained in the first part of the post.

littlehera · April 15, 2017, 12:10pm

This might also help the guys trying to troubleshoot their Debian Stretch installations.
Thanks, @saidsl! Nice guide.

saidsl · April 15, 2017, 1:06pm

@littlehera, Thanks, that’s the idea

Marius_Marolla · May 8, 2017, 9:41am

Thankyou very much for the guide! After the first reboot, before point 1, you’re missing point 0:

git clone GitHub - frappe/bench: CLI to manage Multi-tenant deployments for Frappe apps bench-repo

saidsl · May 9, 2017, 11:04pm

Because we are using PIP sudo pip install -e bench-repo we don’t need to clone from git.

NeisSenni · May 13, 2017, 2:38am

@saidsl, @johnskywalker, technical user prefers manual installation. The manual installation does not work well as the installation document requires update. For help in manual installation please refer to script bench/install_scripts/setup_frappe.sh.

hereabdulla · May 13, 2017, 4:41am

You can release this as wiki in frappe/erpnext github

saidsl · May 13, 2017, 5:37am

I will leave it to the team to include in frappe/erpnext github as I don’t have access.

x1123 · July 19, 2017, 12:53am

I think some people do like manual install for the matters of control. or we can do installation gradually, stop in certain step and continue install in the next day. Easy install/ automated install required certain duration of time which is not everybody have it. Easy install is fully depending on uninterruptible power supply, internet connection which is absent sometimes.

fabyc · July 24, 2017, 8:37pm

Hi everyone,

When I execute this step [1] in tutorial, I get this error [2].

Can you help me please?

Thanks in advanced

[1]
bench init frappe-bench && cd frappe-bench

[2]
Checking connectivity… done.
(‘installing’, u’frappe’)
INFO:bench.app:installing frappe
INFO:bench.utils:frappe-bench/env/bin/pip install -q -e frappe-bench/apps/frappe --no-cache-dir
Command “/home/frappe/frappe-bench/env/bin/python -u -c “import setuptools, tokenize;file=‘/tmp/pip-build-ElvKtM/mysqlclient/setup.py’;f=getattr(tokenize, ‘open’, open)(file);code=f.read().replace(‘\r\n’, ‘\n’);f.close();exec(compile(code, file, ‘exec’))” install --record /tmp/pip-sQbDVS-record/install-record.txt --single-version-externally-managed --compile --install-headers /home/frappe/frappe-bench/env/include/site/python2.7/mysqlclient” failed with error code 1 in /tmp/pip-build-ElvKtM/mysqlclient/
Traceback (most recent call last):
File “/usr/local/bin/bench”, line 11, in
load_entry_point(‘bench’, ‘console_scripts’, ‘bench’)()
File “/home/frappe/bench-repo/bench/cli.py”, line 40, in cli
bench_command()
File “/usr/local/lib/python2.7/dist-packages/click/core.py”, line 722, in call
return self.main(*args, **kwargs)
File “/usr/local/lib/python2.7/dist-packages/click/core.py”, line 697, in main
rv = self.invoke(ctx)
File “/usr/local/lib/python2.7/dist-packages/click/core.py”, line 1066, in invoke
return _process_result(sub_ctx.command.invoke(sub_ctx))
File “/usr/local/lib/python2.7/dist-packages/click/core.py”, line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File “/usr/local/lib/python2.7/dist-packages/click/core.py”, line 535, in invoke
return callback(*args, **kwargs)
File “/home/frappe/bench-repo/bench/commands/make.py”, line 19, in init
verbose=verbose, clone_from=clone_from)
File “/home/frappe/bench-repo/bench/utils.py”, line 56, in init
get_app(frappe_path, branch=frappe_branch, bench_path=path, build_asset_files=False, verbose=verbose)
File “/home/frappe/bench-repo/bench/app.py”, line 76, in get_app
install_app(app=app_name, bench_path=bench_path, verbose=verbose)
File “/home/frappe/bench-repo/bench/app.py”, line 107, in install_app
find_links=find_links))
File “/home/frappe/bench-repo/bench/utils.py”, line 130, in exec_cmd
raise CommandFailedError(cmd)
bench.utils.CommandFailedError: frappe-bench/env/bin/pip install -q -e frappe-bench/apps/frappe --no-cache-dir

bkm · July 24, 2017, 9:19pm

At this point the Easy Install script is NOT compatible with Debian 9 (Stretch) and it tells you that upfront when you try to use it. Hopefully that will change soon. I would like to switch to Debian9, but I am not willing to spend a whole day trying to get it to install manually.

BKM

saidsl · July 25, 2017, 3:55am

@fabyc

The issue seems to be with mysqlclient

error code 1 in /tmp/pip-build-ElvKtM/mysqlclient/

You need to be check with your install if you have all the related packages installed. Do a pip list to ensure that you have everything installed before starting with frappe & erpnext installation bench init frappe-bench && cd frappe-bench

For reference these are the packages running on:

Debian 9

appdirs (1.4.3) bench (4.1.0, /home/frappe/bench-repo) click (6.7) cryptography (1.7.1) enum34 (1.1.6) ez-setup (0.9) gitdb (0.6.4) GitPython (0.3.2rc1) honcho (1.0.1) idna (2.2) ipaddress (1.0.17) Jinja2 (2.9.6) keyring (10.1) keyrings.alt (1.3) MarkupSafe (1.0) meld3 (1.0.2) MySQL-python (1.2.5) mysqlclient (1.3.7) packaging (16.8) pip (9.0.1) psutil (5.2.2) pyasn1 (0.1.9) pycrypto (2.6.1) pygobject (3.22.0) PyMySQL (0.7.11) pyparsing (2.2.0) python-crontab (2.1.1) python-dateutil (2.6.0) pyxdg (0.25) requests (2.13.0) SecretStorage (2.3.1) semantic-version (2.6.0) setuptools (34.4.1) six (1.10.0) smmap (0.9.0) supervisor (3.3.1) virtualenv (15.1.0) wheel (0.29.0)

And these are the packages in Ubuntu 16.10

ansible (2.0.2.0) appdirs (1.4.3) asn1crypto (0.22.0) bench (4.1.0, /home/frappe/.bench) cffi (1.10.0) click (6.7) cryptography (1.8.1) enum34 (1.1.6) gitdb (0.6.4) GitPython (0.3.2rc1) honcho (0.7.1) idna (2.5) ipaddress (1.0.18) Jinja2 (2.9.5) MarkupSafe (1.0) meld3 (1.0.2) MySQL-python (1.2.5) packaging (16.8) paramiko (2.1.2) pip (9.0.1) psutil (5.2.1) pyasn1 (0.2.3) pycparser (2.17) pycrypto (2.6.1) pyparsing (2.2.0) python-apt (1.1.0b5) python-crontab (2.1.1) python-dateutil (2.6.0) PyYAML (3.12) requests (2.13.0) semantic-version (2.6.0) setuptools (34.3.3) six (1.10.0) smmap (0.9.0) supervisor (3.3.1) virtualenv (15.1.0) wheel (0.29.0)

NOTE: I have not updated the installations since I did the guide above a few months back. But it should not impact the installation.

drm-merlin · July 27, 2017, 11:32am

For anyone trying it on Debian 9.1 Clean /Server /VPS
This worked for me and with safer practice of Debian thatis without sudo permission for any user

AS ROOT USER (su)

adduser frappe (if not set initally)

take care to remove conflicting packages e.g. apache2-bin conflicts with nginx

apt install build-essential software-properties-common libssl-dev libmariadbclient-dev python-pip python-setuptools python-mysqldb mariadb-server dirmngr nginx git-core redis-server supervisor wkhtmltopdf

APT will not set ‘root’ PASSWORD in mariadb-server necessary for frappe/ERPnext
YOU NEED TO DO IT MANUALLY.

curl -sL https://deb.nodesource.com/setup_8.x | bash -

apt install nodejs

REBOOT SERVER

Login as As frappe User

git clone GitHub - frappe/bench: CLI to manage Multi-tenant deployments for Frappe apps bench-repo

su (super user/root passowrd)

pip install -e bench-repo

exit (exit superuser)

continue as frappe user

bench init frappe-bench (if bench command doesnt work rerun above pip install again)

bench new-site site1.local

bench start and test

REMAINING EPRNEXT INSTALLATION STEPS AS EARLIER POSTS

If all goes well remove .cache folder from /root folder for safety

kaendra · August 6, 2017, 6:37pm

Hello @saidsl
I’ve been following your guide for manual installing, it worked just perfect until
bench --site site1.local install-app erpnext
It shows an error like this

frappe@erp:~/frappe-bench$ bench --site site1.local install-app erpnext

Installing erpnext…
Updating DocTypes for erpnext : [========== ]Traceback (most recent call last):
File “/usr/lib/python2.7/runpy.py”, line 174, in runmodule_as_main
“main”, fname, loader, pkg_name)
File “/usr/lib/python2.7/runpy.py”, line 72, in runcode
exec code in run_globals
File “/home/frappe/frappe-bench/apps/frappe/frappe/utils/bench_helper.py”, line 94, in
main()
File “/home/frappe/frappe-bench/apps/frappe/frappe/utils/bench_helper.py”, line 18, in main
click.Group(commands=commands)(prog_name=‘bench’)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/click/core.py”, line 722, in call
return self.main(*args, **kwargs)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/click/core.py”, line 697, in main
rv = self.invoke(ctx)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/click/core.py”, line 1066, in invoke
return processresult(sub_ctx.command.invoke(sub_ctx))
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/click/core.py”, line 1066, in invoke
return processresult(sub_ctx.command.invoke(sub_ctx))
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/click/core.py”, line 895, in invoke
return ctx.invoke(self.callback, **ctx.params)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/click/core.py”, line 535, in invoke
return callback(*args, **kwargs)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/click/decorators.py”, line 17, in new_func
return f(get_current_context(), *args, **kwargs)
File “/home/frappe/frappe-bench/apps/frappe/frappe/commands/init.py”, line 24, in _func
ret = f(frappe._dict(ctx.obj), *args, **kwargs)
File “/home/frappe/frappe-bench/apps/frappe/frappe/commands/site.py”, line 160, in install_app
installapp(app, verbose=context.verbose)
File “/home/frappe/frappe-bench/apps/frappe/frappe/installer.py”, line 141, in install_app
sync_for(name, force=True, sync_everything=True, verbose=verbose, reset_permissions=True)
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/sync.py”, line 45, in sync_for
reset_permissions=reset_permissions)
File “/home/frappe/frappe-bench/apps/frappe/frappe/modules/import_file.py”, line 58, in import_file_by_path
ignore_version=ignore_version, reset_permissions=reset_permissions)
File “/home/frappe/frappe-bench/apps/frappe/frappe/modules/import_file.py”, line 129, in import_doc
doc.insert()
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/document.py”, line 219, in insert
self.run_post_save_methods()
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/document.py”, line 790, in run_post_save_methods
self.run_method(“on_update”)
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/document.py”, line 666, in run_method
out = Document.hook(fn)(self, *args, **kwargs)
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/document.py”, line 887, in composer
return composed(self, method, *args, **kwargs)
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/document.py”, line 870, in runner
add_to_return_value(self, fn(self, *args, **kwargs))
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/document.py”, line 660, in
fn = lambda self, args, **kwargs: getattr(self, method)(args, **kwargs)
File “/home/frappe/frappe-bench/apps/frappe/frappe/core/doctype/doctype/doctype.py”, line 203, in on_update
updatedb(self.name, self)
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/db_schema.py”, line 71, in updatedb
tab.sync()
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/db_schema.py”, line 148, in sync
self.create()
File “/home/frappe/frappe-bench/apps/frappe/frappe/model/db_schema.py”, line 183, in create
engine=self.meta.get(“engine”) or ‘InnoDB’) % (self.name, add_text))
File “/home/frappe/frappe-bench/apps/frappe/frappe/database.py”, line 165, in sql
self._cursor.execute(query)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/MySQLdb/cursors.py”, line 250, in execute
self.errorhandler(self, exc, value)
File “/home/frappe/frappe-bench/env/local/lib/python2.7/site-packages/MySQLdb/connections.py”, line 50, in defaulterrorhandler
raise errorvalue
mysqlexceptions.OperationalError: (1005, ‘Can't create table 1bd3e0294da19198.tabSupplier Scorecard Criteria (errno: 168 “Unknown (generic) error from engine”)’)

Things I did differently, out of manual installation guide above are

completely remove Apache2 with apt-get purge apache2*
I’m using official repository from MariaDB 10.2, Nginx and Node.js 8
added these in to my.cnf file, as instructed

[mysqld]
innodb-file-format=barracuda
innodb-file-per-table=1
innodb-large-prefix=1
character-set-client-handshake = FALSE
character-set-server = utf8mb4
collation-server = utf8mb4_unicode_ci
[mysql]
default-character-set = utf8mb4

Installed on Revoluzio Server, fresh VPS server with Ubuntu 16.04

Browsed hundreds of sites on Google, but found nothing specific about this MySQL error like stated above

(errno: 168 “Unknown (generic) error from engine”)')

Maybe, you could identify what I did wrong during the installation. Any help or information would be highly appreciated.

saidsl · August 6, 2017, 10:46pm

@kaendra

I can’t really pin point the exact issue, however, I would suggest you try out the following

bench update --reset
bench migrate

Failing that you can try

bench reinstall

And then try and install ERPNext again

Hope this helps

Regards
Said

TurkerTunali · August 6, 2017, 11:33pm

Best article for a while…
I got these errors on Linux Mint 18.2 when installing MySQL-python with pip but “sudo apt-get install python-dev” resolves it.

_mysql.c:29:20: fatal error: Python.h: No such file or directory
 #include "Python.h"
                    ^
compilation terminated.
error: command 'x86_64-linux-gnu-gcc' failed with exit status 1

saidsl · August 7, 2017, 1:43am

Thank You @TurkerTunali

Glad to know its helping you.

Regards
Said

Guide: Manual Install ERPNext on Ubuntu 16.xx & Debian v8 & 9

Login As Root User or use SUDO

Reboot server Login as As frappe User

Reboot server Login as As frappe User

Debian 9

And these are the packages in Ubuntu 16.10

NOTE: I have not updated the installations since I did the guide above a few months back. But it should not impact the installation.

Reboot server
Login as As frappe User

Reboot server
Login as As frappe User