502 Bad Gateway [21/2/2016]

Good morning,
We are having a gettin 502 Bad Gateway or 504 Gateway Time-out message which unables us from operating.
Thanks in advance , We really appreciate all the great work your team is doing to improve the application.

Now we are getting :

Oops, a server error has occured
Traceback (innermost last):
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/website/render.py”, line 25, in render
data = render_page_by_language(path)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/website/render.py”, line 91, in render_page_by_language
return render_page(path)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/website/render.py”, line 107, in render_page
return build(path)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/website/render.py”, line 114, in build
return build_page(path)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/website/render.py”, line 127, in build_page
context = get_context(path)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/website/context.py”, line 16, in get_context
context = build_context(context)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/website/context.py”, line 54, in build_context
ret = module.get_context(context)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/templates/pages/desk.py”, line 21, in get_context
boot = frappe.sessions.get()
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/sessions.py”, line 106, in get
bootinfo = get_bootinfo()
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/boot.py”, line 55, in get_bootinfo
add_home_page(bootinfo, doclist)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/boot.py”, line 154, in add_home_page
page = frappe.desk.desk_page.get(home_page)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/desk/desk_page.py”, line 14, in get
if page.is_permitted():
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/core/doctype/page/page.py”, line 77, in is_permitted
filters={“parent”: self.name})]
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/init.py”, line 953, in get_all
return get_list(doctype, *args, **kwargs)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/init.py”, line 926, in get_list
return frappe.model.db_query.DatabaseQuery(doctype).execute(None, *args, **kwargs)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/model/db_query.py”, line 50, in execute
result = self.build_and_run()
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/model/db_query.py”, line 58, in build_and_run
args = self.prepare_args()
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/model/db_query.py”, line 72, in prepare_args
self.remove_user_tags()
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/model/db_query.py”, line 165, in remove_user_tags
columns = frappe.db.get_table_columns(self.doctype)
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/database.py”, line 754, in get_table_columns
return [r[0] for r in self.sql(“DESC tab%s” % doctype)]
File “/home/frappe/press/benches/1602191114/apps/frappe/frappe/database.py”, line 147, in sql
self._cursor.execute(query)
File “/home/frappe/press/benches/1602191114/env/lib/python2.7/site-packages/MySQLdb/cursors.py”, line 205, in execute
self.errorhandler(self, exc, value)
File “/home/frappe/press/benches/1602191114/env/lib/python2.7/site-packages/MySQLdb/connections.py”, line 36, in defaulterrorhandler
raise errorclass, errorvalue
InternalError: (23, ‘Out of resources when opening file '/tmp/#sql_828_0.MAI' (Errcode: 24 “Too many open files”)’)

Back to normal , Thanks
We would appreaciate if you could inform your cloud customers of any action that may temporaly disable the application as we have daily operation to runs .
Thank you for your continous support

@Manu there were some urgent security updates we applied on the operating system. Sorry we couldn’t inform you ahead in time. It took about 5 minutes to restart the server and hence the downtime. However, we got an unexpected problem in our database server which took us another 10 mins to figure out. Sorry for the downtime.