/usr/local/lib64/python3.6/site-packages/pyarrow/tests/__pycache__
Edit: /usr/local/lib64/python3.6/site-packages/pyarrow/tests/__pycache__/util.cpython-36.pyc (10438B)
3
9%Eg3# @ s d Z ddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
ZddlZ
dd Zejdd Zdd Zd d
Zd d Zd
d Zd(ddZdd Zdd Zejdd Zejdd Zejd d Z d d Z G d!d" d"Z G d#d$ d$e
j j Z!d%d& Z"dS ))z
Utility functions for testing
Nc C s
t jdS )zLRandomly choose either 1 or -1.
Returns
-------
sign : int
)r r )randomchoice r r >/usr/local/lib64/python3.6/site-packages/pyarrow/tests/util.pyrandsign' s r c c s. t j }t j| z
dV W dt j| X dS )a Set the random seed inside of a context manager.
Parameters
----------
seed : int
The seed to set
Notes
-----
This function is useful when you want to set a random seed but not affect
the random state of other functions using the random module.
N)r getstateseedsetstate)r
Zoriginal_stater r r random_seed1 s
r c C s d| kodkn s t d|dk r0tdd| | d }tj| |}|s\tj|S d| d }tjd|}tjdj|t|j|dS ) a Generate a random decimal value with specified precision and scale.
Parameters
----------
precision : int
The maximum number of digits to generate. Must be an integer between 1
and 38 inclusive.
scale : int
The maximum number of digits following the decimal point. Must be an
integer greater than or equal to 0.
Returns
-------
decimal_value : decimal.Decimal
A random decimal.Decimal object with the specified precision and scale.
r & z,precision must be between 1 and 38 inclusiver zHranddecimal does not yet support generating decimals with negative scale
z{}.{}0) AssertionError
ValueErrorr randintdecimalDecimalformatstrrjust)Z precisionZscaleZmax_whole_valueZwholeZmax_fractional_valueZ
fractionalr r r randdecimalG s
r c C s t tjjdd| ddS )NA { i1)sizedtype)bytesnpr r )lengthr r r random_asciil s r! c C s4 t jttjtj t jdfd}djt jj || S )z%
Generate one random string.
r )r )
r arrayliststring
ascii_lettersdigitsZstr_joinr r )ZncharsZ RANDS_CHARSr r r randsp s r) c sJ dd l } d | j fddtjd d D | jdd t D d}|S ) Nr c s i | ]}t jj |qS r )r r Zrandn).0col)Nr r
~ s z"make_dataframe.. c S s g | ] }t d qS )r )r) )r+ _r r r
s z"make_dataframe..)index)ZpandasZ DataFramer% ascii_uppercaseIndexrange)pddfr )r- r make_dataframey s r8 rssr r c sd ddl }|j fdd fdd}x(t|D ] | | dkr@| q@W dS )a
Execute the function and try to detect a clear memory leak either internal
to Arrow or caused by a reference counting problem in the Python binding
implementation. Raises exception if a leak detected
Parameters
----------
f : callable
Function to invoke on each iteration
metric : {'rss', 'vms', 'shared'}, default 'rss'
Attribute of psutil.Process.memory_info to use for determining current
memory use
threshold : int, default 128K
Threshold in number of bytes to consider a leak
iterations : int, default 10
Total number of invocations of f
check_interval : int, default 1
Number of invocations of f in between each memory use check
r Nc s t j tj S )N)gcZcollectgetattrZ memory_infor )metricprocr r _get_use s z#memory_leak_check.._get_usec s* } | kr&t dj| d S )NzDMemory leak detected. Departure from baseline {} after {} iterations) Exceptionr )Z current_use)r? baseline_usei thresholdr r _leak_check s z&memory_leak_check.._leak_check)psutilProcessr5 )fr= rC Z
iterationsZcheck_intervalrE rD r )r? rA rB r= r> rC r memory_leak_check s rH c C sZ t jj } | jdd}t jjt jjt jjtj}|rJt j j
||f}n|}|| d< | S )N
PYTHONPATHr" ) osenvironcopygetpathabspathdirnamepa__file__pathsepr( )envZexisting_pythonpath module_pathZnew_pythonpathr r r get_modified_env_with_pythonpath s
rV c G sN t }tjjtjjt}tjj|| }tj|g}|j | t
j ||d d S )N)rT ) rV rJ rN rP realpathrR r( sys
executableextend
subprocess
check_call) script_nameargsZsubprocess_envZdir_pathZ python_filecmdr r r
invoke_script s
r` c c sD t jj| }|t j| < z
dV W d|dkr4t j| = n
|t j| < X dS )zA
Temporarily set environment variable *name* to *value*.
N)rJ rK rM )namevalueZ
orig_valuer r r changed_environ s
rc c c s2 t j }t jt| z
d V W d t j| X d S )N)rJ getcwdchdirr )rN curdirr r r
change_cwd s
rg c
c s" t j z
d V W d t j X d S )N)r; disableenabler r r r disabled_gc s
rj c C s$ t jdkrdj| }n
dj| }|S )Nntz
file:///{}z file://{})rJ ra r )rN urir r r _filesystem_uri s
rm c @ s e Zd Zdd Zdd ZdS )FSProtocolClassc C s
|| _ d S )N)_path)selfrN r r r __init__ s zFSProtocolClass.__init__c C s
t | jS )N)r ro )rp r r r
__fspath__ s zFSProtocolClass.__fspath__N)__name__
__module__ __qualname__rq rr r r r r rn s rn c @ s e Zd ZdZdd Zdd Zdd Zdd Zd
d Zd d
Z dd Z
dd Z dd Z dd Z
dd Zdd Zdd Zd d Zd d Zd d! Zd"d# Zd$d% Zd&S )' ProxyHandlerz
A dataset handler that proxies to an underlying filesystem. Useful
to partially wrap an existing filesystem with partial changes.
c C s
|| _ d S )N)_fs)rp fsr r r rq s zProxyHandler.__init__c C s t |tr| j|jkS tS )N)
isinstancerv rw NotImplemented)rp otherr r r __eq__ s
zProxyHandler.__eq__c C s t |tr| j|jkS tS )N)ry rv rw rz )rp r{ r r r __ne__
s
zProxyHandler.__ne__c C s d| j j S )Nzproxy::)rw type_name)rp r r r
get_type_name s zProxyHandler.get_type_namec C s | j j|S )N)rw normalize_path)rp rN r r r r s zProxyHandler.normalize_pathc C s | j j|S )N)rw
get_file_info)rp pathsr r r r s zProxyHandler.get_file_infoc C s | j j|S )N)rw r )rp selectorr r r get_file_info_selector s z#ProxyHandler.get_file_info_selectorc C s | j j||dS )N) recursive)rw
create_dir)rp rN r r r r r s zProxyHandler.create_dirc C s | j j|S )N)rw
delete_dir)rp rN r r r r ! s zProxyHandler.delete_dirc C s | j j|S )N)rw delete_dir_contents)rp rN r r r r $ s z ProxyHandler.delete_dir_contentsc C s | j jdddS )Nr" T)Zaccept_root_dir)rw r )rp r r r delete_root_dir_contents' s z%ProxyHandler.delete_root_dir_contentsc C s | j j|S )N)rw delete_file)rp rN r r r r * s zProxyHandler.delete_filec C s | j j||S )N)rw move)rp srcdestr r r r - s zProxyHandler.movec C s | j j||S )N)rw copy_file)rp r r r r r r 0 s zProxyHandler.copy_filec C s | j j|S )N)rw open_input_stream)rp rN r r r r 3 s z ProxyHandler.open_input_streamc C s | j j|S )N)rw open_input_file)rp rN r r r r 6 s z ProxyHandler.open_input_filec C s | j j||dS )N)metadata)rw open_output_stream)rp rN r r r r r 9 s z ProxyHandler.open_output_streamc C s | j j||dS )N)r )rw open_append_stream)rp rN r r r r r < s z ProxyHandler.open_append_streamN)rs rt ru __doc__rq r| r} r r r r r r r r r r r r r r r r r r r rv s& rv c C s6 t jdkrtjS tjdkr&tjd n dd } | S d S )N rk z$test requires Python 3.8+ on Windowsc S s t jt j | d S )N)rJ killgetpid)signumr r r raise_signalI s z&get_raise_signal..raise_signal)r r )rX version_infosignalr rJ ra pytestskip)r r r r get_raise_signal@ s
r )r9 r r r )#r
contextlibr r; Znumpyr rJ r r r% r[ rX r ZpyarrowrQ Z
pyarrow.fsr contextmanagerr r r! r) r8 rH rV r` rc rg rj rm rn rx ZFileSystemHandlerrv r r r r r s<
%
*
A