Tools (xonsh.tools)

Misc. xonsh tools.

The following implementations were forked from the IPython project:

Implementations:

  • decode()
  • encode()
  • cast_unicode()
  • safe_hasattr()
  • indent()
exception xonsh.tools.XonshBlockError(lines, glbs, locs, *args, **kwargs)[source]

Special xonsh exception for communicating the lines of block bodies.

Parameters:

lines : list f str

Block lines, as if split by str.splitlines().

glbs : Mapping or None

Global execution context for lines, ie globals() of calling frame.

locs : Mapping or None

Local execution context for lines, ie locals() of calling frame.

with_traceback()

Exception.with_traceback(tb) – set self.__traceback__ to tb and return self.

args
exception xonsh.tools.XonshCalledProcessError(returncode, command, output=None, stderr=None, completed_command=None)[source]

Raised when there’s an error with a called process

Inherits from XonshError and subprocess.CalledProcessError, catching either will also catch this error.

Raised after iterating over stdout of a captured command, if the returncode of the command is nonzero.

Example:
try:
for line in !(ls):
print(line)
except subprocess.CalledProcessError as error:
print(“Error in process: {}.format(error.completed_command.pid))

This also handles differences between Python3.4 and 3.5 where CalledProcessError is concerned.

with_traceback()

Exception.with_traceback(tb) – set self.__traceback__ to tb and return self.

args
stdout

Alias for output attribute, to match stderr

exception xonsh.tools.XonshError[source]
with_traceback()

Exception.with_traceback(tb) – set self.__traceback__ to tb and return self.

args
class xonsh.tools.DefaultNotGivenType[source]

Singleton for representing when no default value is given.

class xonsh.tools.EnvPath(args=None)[source]

A class that implements an environment path, which is a list of strings. Provides a custom method that expands all paths if the relevant env variable has been set.

append(value)

S.append(value) – append value to the end of the sequence

clear() → None -- remove all items from S
count(value) → integer -- return number of occurrences of value
extend(values)

S.extend(iterable) – extend sequence by appending elements from the iterable

index(value[, start[, stop]]) → integer -- return first index of value.

Raises ValueError if the value is not present.

insert(index, value)[source]
pop([index]) → item -- remove and return item at index (default last).

Raise IndexError if list is empty or index is out of range.

remove(value)

S.remove(value) – remove first occurrence of value. Raise ValueError if the value is not present.

reverse()

S.reverse() – reverse IN PLACE

paths

Returns the list of directories that this EnvPath contains.

class xonsh.tools.redirect_stderr(new_target)[source]

Context manager for temporarily redirecting stderr to another file.

class xonsh.tools.redirect_stdout(new_target)[source]

Context manager for temporarily redirecting stdout to another file:

# How to send help() to stderr
with redirect_stdout(sys.stderr):
    help(dir)

# How to write help() to a file
with open('help.txt', 'w') as f:
    with redirect_stdout(f):
        help(pow)

Mostly for backwards compatibility.

xonsh.tools.always_false(x)[source]

Returns False

xonsh.tools.always_true(x)[source]

Returns True

xonsh.tools.argvquote(arg, force=False)[source]

Returns an argument quoted in such a way that that CommandLineToArgvW on Windows will return the argument string unchanged. This is the same thing Popen does when supplied with an list of arguments. Arguments in a command line should be separated by spaces; this function does not add these spaces. This implementation follows the suggestions outlined here: https://blogs.msdn.microsoft.com/twistylittlepassagesallalike/2011/04/23/everyone-quotes-command-line-arguments-the-wrong-way/

xonsh.tools.backup_file(fname)[source]

Moves an existing file to a new name that has the current time right before the extension.

xonsh.tools.bool_or_int_to_str(x)[source]

Converts a boolean or integer to a string.

xonsh.tools.bool_seq_to_csv(x)[source]

Converts a sequence of bools to a comma-separated string.

xonsh.tools.bool_to_str(x)[source]

Converts a bool to an empty string if False and the string ‘1’ if True.

xonsh.tools.cast_unicode(s, encoding=None)[source]
xonsh.tools.check_for_partial_string(x)[source]

Returns the starting index (inclusive), ending index (exclusive), and starting quote string of the most recent Python string found in the input.

check_for_partial_string(x) -> (startix, endix, quote)

Parameters:

x : str

The string to be checked (representing a line of terminal input)

Returns:

startix : int (or None)

The index where the most recent Python string found started (inclusive), or None if no strings exist in the input

endix : int (or None)

The index where the most recent Python string found ended (exclusive), or None if no strings exist in the input OR if the input ended in the middle of a Python string

quote : str (or None)

A string containing the quote used to start the string (e.g., b”, ”, ‘’‘), or None if no string was found.

xonsh.tools.color_style()[source]

Returns the current color map.

xonsh.tools.color_style_names()[source]

Returns an iterable of all available style names.

xonsh.tools.command_not_found(cmd)[source]

Uses the debian/ubuntu command-not-found utility to suggest packages for a command that cannot currently be found.

xonsh.tools.csv_to_bool_seq(x)[source]

Takes a comma-separated string and converts it into a list of bools.

xonsh.tools.csv_to_set(x)[source]

Convert a comma-separated list of strings to a set of strings.

xonsh.tools.decode(s, encoding=None)[source]
xonsh.tools.decode_bytes(path)[source]

Tries to decode a path in bytes using XONSH_ENCODING if available, otherwise using sys.getdefaultencoding().

xonsh.tools.display_error_message()[source]

Prints the error message of the current exception on stderr.

xonsh.tools.dynamic_cwd_tuple_to_str(x)[source]

Convert a canonical cwd_width tuple to a string.

xonsh.tools.encode(u, encoding=None)[source]
xonsh.tools.ensure_slice(x)[source]

Try to convert an object into a slice, complain on failure

xonsh.tools.ensure_string(x)[source]

Returns a string if x is not a string, and x if it already is.

xonsh.tools.ensure_timestamp(t, datetime_format=None)[source]
xonsh.tools.env_path_to_str(x)[source]

Converts an environment path to a string by joining on the OS separator.

xonsh.tools.escape_windows_cmd_string(s)[source]

Returns a string that is usable by the Windows cmd.exe. The escaping is based on details here and emperical testing: http://www.robvanderwoude.com/escapechars.php

xonsh.tools.executables_in(path)[source]

Returns a generator of files in path that the user could execute.

xonsh.tools.expand_case_matching(s)[source]

Expands a string to a case insensitive globable string.

xonsh.tools.expand_gray_colors_for_cmd_exe(style_map)[source]

Expand the style’s gray scale color range. All gray scale colors has a tendency to map to the same default GRAY in cmd.exe.

xonsh.tools.expandpath(path)[source]

Performs environment variable / user expansion on a given path if the relevant flag has been set.

xonsh.tools.expanduser_abs_path(inp)[source]

Provides user expanded absolute path

xonsh.tools.expandvars(path)[source]

Expand shell variables of the forms $var, ${var} and %var%. Unknown variables are left unchanged.

xonsh.tools.fallback(cond, backup)[source]

Decorator for returning the object if cond is true and a backup if cond is false.

xonsh.tools.find_next_break(line, mincol=0, lexer=None)[source]

Returns the column number of the next logical break in subproc mode. This function may be useful in finding the maxcol argument of subproc_toks().

xonsh.tools.format_color(string, **kwargs)[source]

Formats strings that may contain colors. This simply dispatches to the shell instances method of the same name. The results of this function should be directly usable by print_color().

xonsh.tools.get_sep()[source]

Returns the appropriate filepath separator char depending on OS and xonsh options set

xonsh.tools.globpath(s, ignore_case=False, return_empty=False, sort_result=None)[source]

Simple wrapper around glob that also expands home and env vars.

xonsh.tools.history_tuple_to_str(x)[source]

Converts a valid history tuple to a canonical string.

xonsh.tools.iglobpath(s, ignore_case=False, sort_result=None)[source]

Simple wrapper around iglob that also expands home and env vars.

xonsh.tools.indent(instr, nspaces=4, ntabs=0, flatten=False)[source]

Indent a string a given number of spaces or tabstops.

indent(str,nspaces=4,ntabs=0) -> indent str by ntabs+nspaces.

Parameters:

instr : basestring

The string to be indented.

nspaces : int (default: 4)

The number of spaces to be indented.

ntabs : int (default: 0)

The number of tabs to be indented.

flatten : bool (default: False)

Whether to scrub existing indentation. If True, all lines will be aligned to the same indentation. If False, existing indentation will be strictly increased.

Returns:

outstr : string indented by ntabs and nspaces.

xonsh.tools.intensify_colors_for_cmd_exe(style_map, replace_colors=None)[source]

Returns a modified style to where colors that maps to dark colors are replaced with brighter versions. Also expands the range used by the gray colors

xonsh.tools.intensify_colors_on_win_setter(enable)[source]

Resets the style when setting the INTENSIFY_COLORS_ON_WIN environment variable.

xonsh.tools.is_bool(x)[source]

Tests if something is a boolean.

xonsh.tools.is_bool_or_int(x)[source]

Returns whether a value is a boolean or integer.

xonsh.tools.is_bool_seq(x)[source]

Tests if an object is a sequence of bools.

xonsh.tools.is_callable(x)[source]

Tests if something is callable

xonsh.tools.is_completions_display_value(x)[source]
xonsh.tools.is_dynamic_cwd_width(x)[source]

Determine if the input is a valid input for the DYNAMIC_CWD_WIDTH environement variable.

xonsh.tools.is_env_path(x)[source]

This tests if something is an environment path, ie a list of strings.

xonsh.tools.is_float(x)[source]

Tests if something is a float

xonsh.tools.is_history_tuple(x)[source]

Tests if something is a proper history value, units tuple.

xonsh.tools.is_int(x)[source]

Tests if something is an integer

xonsh.tools.is_int_as_str(x)[source]

Test if string x is an integer. If not a string return False.

xonsh.tools.is_logfile_opt(x)[source]

Checks if x is a valid $XONSH_TRACEBACK_LOGFILE option. Returns False if x is not a writable/creatable file or an empty string or None.

xonsh.tools.is_nonstring_seq_of_strings(x)[source]

Tests if something is a sequence of strings, where the top-level sequence is not a string itself.

xonsh.tools.is_slice(x)[source]

Tests if something is a slice

xonsh.tools.is_slice_as_str(x)[source]

Test if string x is a slice. If not a string return False.

xonsh.tools.is_string(x)[source]

Tests if something is a string

xonsh.tools.is_string_or_callable(x)[source]

Tests if something is a string or callable

xonsh.tools.is_string_seq(x)[source]

Tests if something is a sequence of strings

xonsh.tools.is_string_set(x)[source]

Tests if something is a set of strings

xonsh.tools.is_writable_file(filepath)[source]

Checks if a filepath is valid for writing.

xonsh.tools.levenshtein(a, b, max_dist=inf)[source]

Calculates the Levenshtein distance between a and b.

xonsh.tools.logfile_opt_to_str(x)[source]

Detypes a $XONSH_TRACEBACK_LOGFILE option.

xonsh.tools.normabspath(p)[source]

Retuns as normalized absolute path, namely, normcase(abspath(p))

xonsh.tools.on_main_thread()[source]

Checks if we are on the main thread or not.

xonsh.tools.pathsep_to_seq(x)[source]

Converts a os.pathsep separated string to a sequence of strings.

xonsh.tools.pathsep_to_set(x)[source]

Converts a os.pathsep separated string to a set of strings.

xonsh.tools.pathsep_to_upper_seq(x)[source]

Converts a os.pathsep separated string to a sequence of uppercase strings.

xonsh.tools.print_color(string, **kwargs)[source]

Prints a string that may contain colors. This dispatched to the shell method of the same name. Colors will be formatted if they have not already been.

xonsh.tools.print_exception(msg=None)[source]

Print exceptions with/without traceback.

xonsh.tools.safe_hasattr(obj, attr)[source]

In recent versions of Python, hasattr() only catches AttributeError. This catches all errors.

xonsh.tools.seq_to_pathsep(x)[source]

Converts a sequence to an os.pathsep separated string.

xonsh.tools.seq_to_upper_pathsep(x)[source]

Converts a sequence to an uppercase os.pathsep separated string.

xonsh.tools.set_to_csv(x)[source]

Convert a set of strings to a comma-separated list of strings.

xonsh.tools.set_to_pathsep(x, sort=False)[source]

Converts a set to an os.pathsep separated string. The sort kwarg specifies whether to sort the set prior to str conversion.

xonsh.tools.setup_win_unicode_console(enable)[source]

“Enables or disables unicode display on windows.

xonsh.tools.str_to_env_path(x)[source]

Converts a string to an environment path, ie a list of strings, splitting on the OS separator.

xonsh.tools.subexpr_from_unbalanced(expr, ltok, rtok)[source]

Attempts to pull out a valid subexpression for unbalanced grouping, based on opening tokens, eg. ‘(‘, and closing tokens, eg. ‘)’. This does not do full tokenization, but should be good enough for tab completion.

xonsh.tools.subproc_toks(line, mincol=-1, maxcol=None, lexer=None, returnline=False)[source]

Excapsulates tokens in a source code line in a uncaptured subprocess ![] starting at a minimum column. If there are no tokens (ie in a comment line) this returns None.

xonsh.tools.suggest_commands(cmd, env, aliases)[source]

Suggests alternative commands given an environment and aliases.

xonsh.tools.suggestion_sort_helper(x, y)[source]

Returns a score (lower is better) for x based on how similar it is to y. Used to rank suggestions.

xonsh.tools.swap(namespace, name, value, default=NotImplemented)[source]

Swaps a current variable name in a namespace for another value, and then replaces it when the context is exited.

xonsh.tools.to_bool(x)[source]

“Converts to a boolean in a semantically meaningful way.

xonsh.tools.to_bool_or_break(x)[source]
xonsh.tools.to_bool_or_int(x)[source]

Converts a value to a boolean or an integer.

xonsh.tools.to_completions_display_value(x)[source]
xonsh.tools.to_dynamic_cwd_tuple(x)[source]

Convert to a canonical cwd_width tuple.

xonsh.tools.to_history_tuple(x)[source]

Converts to a canonincal history tuple.

xonsh.tools.to_logfile_opt(x)[source]

Converts a $XONSH_TRACEBACK_LOGFILE option to either a str containing the filepath if it is a writable file or None if the filepath is not valid, informing the user on stderr about the invalid choice.

xonsh.tools.HISTORY_UNITS = {'': ('commands', <class 'int'>), 'years': ('s', <function <lambda>>), 's': ('s', <class 'float'>), 'day': ('s', <function <lambda>>), 'commands': ('commands', <class 'int'>), 'cmd': ('commands', <class 'int'>), 'gigs': ('b', <function <lambda>>), 'megabytes': ('b', <function <lambda>>), 'megabyte': ('b', <function <lambda>>), 'mon': ('s', <function <lambda>>), 'hour': ('s', <function <lambda>>), 'f': ('files', <class 'int'>), 'h': ('s', <function <lambda>>), 'terabyte': ('b', <function <lambda>>), 'files': ('files', <class 'int'>), 'megs': ('b', <function <lambda>>), 'c': ('commands', <class 'int'>), 'yrs': ('s', <function <lambda>>), 'mb': ('b', <function <lambda>>), 'months': ('s', <function <lambda>>), 'days': ('s', <function <lambda>>), 'd': ('s', <function <lambda>>), 'second': ('s', <class 'float'>), 'gigabytes': ('b', <function <lambda>>), 'gig': ('b', <function <lambda>>), 'yr': ('s', <function <lambda>>), 'tb': ('b', <function <lambda>>), 'kilobyte': ('b', <function <lambda>>), 'terabytes': ('b', <function <lambda>>), 'cmds': ('commands', <class 'int'>), 'm': ('s', <function <lambda>>), 'seconds': ('s', <class 'float'>), 'min': ('s', <function <lambda>>), 'sec': ('s', <class 'float'>), 'y': ('s', <function <lambda>>), 'kilobytes': ('b', <function <lambda>>), 'command': ('commands', <class 'int'>), 'mins': ('s', <function <lambda>>), 'gb': ('b', <function <lambda>>), 'byte': ('b', <class 'int'>), 'hours': ('s', <function <lambda>>), 'b': ('b', <class 'int'>), 'gigabyte': ('b', <function <lambda>>), 'meg': ('b', <function <lambda>>), 'bytes': ('b', <class 'int'>), 'kb': ('b', <function <lambda>>), 'year': ('s', <function <lambda>>), 'month': ('s', <function <lambda>>), 'hr': ('s', <function <lambda>>)}

Maps lowercase unit names to canonical name and conversion utilities.

xonsh.tools.RE_BEGIN_STRING = re.compile('([bBrRuU]*("""|\'\'\'|"|\'))')

Regular expression matching the start of a string, including quotes and leading characters (r, b, or u)

xonsh.tools.RE_STRING_CONT = <xonsh.lazyasd.LazyDict object>

Dictionary mapping starting quote sequences to regular expressions that match the contents of a string beginning with those quotes (not including the terminating quotes)

xonsh.tools.RE_STRING_START = re.compile('[bBrRuU]*')

Regular expression matching the characters before the quotes when starting a string (r, b, or u, case insensitive)

xonsh.tools.is_superuser[source]